Distributed File System with Disaggregated Data Management and Storage Management Layers

Abstract

Systems and methods for managing data storage using a distributed file system are provided. In one example, a relocation event is detected that indicates a relocation is to be initialized. The relocation is initialized by identifying a destination node of a distributed storage system for the relocation of a set of objects in a cluster database, including a logical block device, a corresponding logical aggregate, and a corresponding file system volume. A state of each of the set of objects is changed to offline. The set of objects are then relocated from an originating node of the distributed storage system to the destination node in which the corresponding logical aggregate is relocated after the logical block device and the corresponding file system volume is relocated after the logical aggregate. Finally, the state of each of the set of objects is changed to online.

What is claimed is: 
     
         1 . A method comprising:
 detecting a relocation event within a distributed storage system that indicates a relocation is to be initialized;   initializing the relocation by identifying a destination node of the distributed storage system for the relocation of a set of objects in a cluster database, the set of objects including a logical block device, a corresponding logical aggregate, and a corresponding file system volume;   changing a state of each of the set of objects to offline;   after said changing, relocating the set of objects from an originating node of the distributed storage system to the destination node, wherein the corresponding logical aggregate is relocated after the logical block device and the corresponding file system volume is relocated after the logical aggregate; and   after said relocating, changing the state of each of the set of objects to online.   
     
     
         2 . The method of  claim 1 , wherein the relocating comprises relocating metadata associated with the logical block device to the destination node. 
     
     
         3 . The method of  claim 1 , wherein the relocating does not cause any data movement from the originating node to the destination node. 
     
     
         4 . The method of  claim 1 , further comprising forming a new primary metadata object corresponding to the logical block device based on the relocation of the logical block device to the destination node. 
     
     
         5 . The method of  claim 4 , wherein the destination node hosts a replica of an original primary metadata object corresponding to the logical block device and wherein forming the new primary metadata object comprises promoting the replica to be the new primary metadata object. 
     
     
         6 . The method of  claim 4 , wherein forming the new primary metadata object comprises moving an original primary metadata object corresponding to the logical block device to the destination node to form the new primary metadata object corresponding to the logical block device. 
     
     
         7 . A distributed storage system comprising:
 a processor; and   a machine-readable medium having instructions stored thereon that when executed by the processor, cause the distributed storage system to:
 identify a destination node of the distributed storage system for relocation of a set of objects in a cluster database, the set of objects including a logical block device and a corresponding logical aggregate or a corresponding file system volume; 
 change a state of each of the set of objects to offline; 
 relocate the set of objects from an originating node of the distributed storage system to the destination node by relocating metadata associated with the logical block device from the originating node to the destination node without performing data movement from the originating node to the destination node; and 
 change the state of each of the set of objects to online. 
   
     
     
         8 . The distributed storage system of  claim 7 , wherein the corresponding logical aggregate is relocated after the logical block device and the corresponding file system volume is relocated after the logical aggregate. 
     
     
         9 . The distributed storage system of  claim 7 , wherein the instructions further cause the distributed storage system to form a new primary metadata object corresponding to the logical block device based on the relocation of the logical block device to the destination node. 
     
     
         10 . The distributed storage system of  claim 9 , wherein the destination node hosts a replica of an original primary metadata object corresponding to the logical block device and wherein formation of the new primary metadata object comprises promoting the replica to be the new primary metadata object. 
     
     
         11 . The distributed storage system of  claim 9 , wherein formation of the new primary metadata object comprises moving an original primary metadata object corresponding to the logical block device to the destination node to form the new primary metadata object corresponding to the logical block device. 
     
     
         12 . The distributed storage system of  claim 7 , wherein one or more of the originating node and the destination node comprise a virtual implementation or representation of a storage controller or a server. 
     
     
         13 . The distributed storage system of  claim 7 , wherein one or more of the originating node and the destination node are operable within a respective virtual machine of a cloud computing environment. 
     
     
         14 . A non-transitory machine readable medium storing instructions, which when executed by one or more processors of a distributed storage system, cause the distributed storage system to:
 identify a destination node of the distributed storage system for relocation of a set of objects in a cluster database, the set of objects including a logical block device, a logical aggregate, and a file system volume; and   relocate the set of objects from an originating node of the distributed storage system to the destination node by relocating metadata associated with the logical block device from the originating node to the destination node without performing data movement from the originating node to the destination node.   
     
     
         15 . The non-transitory machine readable medium of  claim 14 , wherein the logical aggregate is relocated after the logical block device and the file system volume is relocated after the logical aggregate. 
     
     
         16 . The non-transitory machine readable medium of  claim 14 , wherein the instructions further cause the distributed storage system to form a new primary metadata object corresponding to the logical block device based on the relocation of the logical block device to the destination node. 
     
     
         17 . The non-transitory machine readable medium of  claim 16 , wherein the destination node hosts a replica of an original primary metadata object corresponding to the logical block device and wherein formation of the new primary metadata object comprises promoting the replica to be the new primary metadata object. 
     
     
         18 . The non-transitory machine readable medium of  claim 16 , wherein formation of the new primary metadata object comprises moving an original primary metadata object corresponding to the logical block device to the destination node to form the new primary metadata object corresponding to the logical block device. 
     
     
         19 . The non-transitory machine readable medium of  claim 14 , wherein one or more of the originating node and the destination node comprise a virtual implementation or representation of a storage controller or a server. 
     
     
         20 . The non-transitory machine readable medium of  claim 14 , wherein one or more of the originating node and the destination node are operable within a respective virtual machine of a cloud computing environment.