Decentralizing a hadoop cluster

Abstract

In some examples, a distributed file system is described. The distributed file system may include multiple data nodes and a director unit. The multiple data nodes may each include one or more data blocks. The director unit may include multiple master nodes configured in a peer-to-peer distributed architecture and operably coupled to the multiple data nodes. Each of the master nodes may be configured to receive a task related to managing data with respect to the distributed file system; to manage a distribution of the task among one or more of the plurality of master nodes; and to communicate a task status and a status of at least a part of the distributed file system to each of the other master nodes.

What is claimed is: 
     
         1 . A distributed file system comprising:
 a plurality of data nodes that each comprises one or more data blocks; and   a director unit including a plurality of master nodes configured in a peer-to-peer distributed architecture and operably coupled to the plurality of data nodes, each master node of the plurality of master nodes configured to:
 receive a task related to managing data with respect to the distributed file system; 
 manage a distribution of the task among one or more of the plurality of master nodes; and 
 communicate a task status and a status of at least a part of the distributed file system to each of the other plurality of master nodes.