System and method for multi-tiered meta-data caching and distribution in a clustered computer environment

Abstract

A system and method caches and distributes meta-data for one or more data containers stored on a plurality of volumes configured as a striped volume set (SVS) and served by a plurality of nodes interconnected as a cluster. The SVS comprises one meta-data volume (MDV) configured to store a canonical copy of certain meta-data, including access control lists and directories, associated with all data containers stored on the SVS, and one or more data volumes (DV) configured to store, at least, data content of those containers. In addition, for each data container stored on the SVS, one volume is designated a container attribute volume (CAV) and, as such, is configured to store (“cache”) a canonical copy of certain, rapidly-changing attribute meta-data, including time stamps and container length, associated with that container.

What is claimed is: 
     
         1 . A method comprising:
 organizing a plurality of logical volumes as a striped volume set;   designating a first of the plurality of volumes as a meta data volume of the striped volume set;   designating a second of the plurality of volumes as a container attribute volume associated with a data container stored within the striped volume set, wherein the container attribute volume serves as a first tier caching and distribution point for metadata associated with the data container; and   invalidating a cached copy of the metadata stored on the container attribute volume in response to receiving a data access request.   
     
     
         2 . The method of  claim 1  wherein selecting one of the plurality of logical volumes as the container attribute volume comprises selecting a data volume of the striped volume set storing a first stripe of the data container. 
     
     
         3 . The method of  claim 1  wherein the data container comprises a file. 
     
     
         4 . The method of  claim 1  wherein at least one of the plurality of logical volumes comprises a logical arrangement of a plurality of storage devices. 
     
     
         5 . The method of  claim 5  wherein the plurality of storage devices comprise disks. 
     
     
         6 . The method of  claim 1  wherein the container attribute volume stores a subset of the metadata stored on the metadata volume. 
     
     
         7 . The method of  claim 6  wherein the subset comprises an access control list. 
     
     
         8 . The method of  claim 1  wherein the logical volumes comprise flexible volumes. 
     
     
         9 . A system comprising:
 a processor executing a storage operating system, the storage operating system having a file system configured to stripe a data container across a striped volume set, wherein the stripe volume set comprises of a plurality of logical volumes;   a first of the plurality of logical volumes configured as a metadata volume to store metadata associated with the data container;   a second of the plurality of the logical volumes configured as a container attribute volume configured as a first tier caching and distribution point within the striped volumes et for the metadata in the metadata volume; and   a volume stripping module of the storage operating system configured to transmit a command to invalidate the cached copy of the metadata on the container attribute volume.   
     
     
         10 . The system of  claim 9  wherein the data container comprises a file. 
     
     
         11 . The system of  claim 9  wherein each of the plurality of volumes is a logical arrangement of a plurality of storage devices. 
     
     
         12 . The system of  claim 11  wherein the storage devices comprise disks. 
     
     
         13 . The system of  claim 9  wherein the metadata is organized into a plurality of categories asked on a frequency that metadata changes in response to receiving a data access request directed to the data container. 
     
     
         14 . The system of  claim 9  wherein the container attribute volume is a logical volume storing a first stripe of the data container.