System and methods for implementing a server-based hierarchical mass storage system

Abstract

Setting up and supporting the computer infrastructure for a remote satellite office is a difficult task for any information technology department. To simplify the task, an integrated server system with a hierarchical storage system is proposed. The hierarchical storage system includes the ability to store data at an off-site cloud storage service. The server system is remotely configurable and thus allows the server to be configured and populated with data from a remote location.

1 . A method comprising:
 in a server system connected to a network connection and comprising a hierarchical storage stack for storing data, wherein the hierarchical storage stack comprises a local data storage layer for storing data locally in the server system and a remote data storage layer that stores data with a remote data storage service;   utilizing the local data storage layer as a read-ahead cache for the remote data storage layer by:
 identifying a selected data object of the remote data storage layer that is absent in the local data storage layer; and 
 before receiving an incoming request to access the selected data object, moving the selected data object from the remote data storage layer to the local data storage layer. 
   
     
     
         2 . The method of  claim 1 , wherein the selected data object is identified using heuristics to identify data that is likely to be requested soon. 
     
     
         3 . The method of  claim 1 , wherein the selected data object is accessed infrequently but a low latency response is needed when the data object is accessed. 
     
     
         4 . The method of  claim 1 , wherein the remote data storage service comprises an off-site data storage provider. 
     
     
         5 . The method of  claim 1 , further comprising exposing a network storage interface for applications to access the hierarchical storage stack. 
     
     
         6 . The method of  claim 1 , wherein the hierarchical storage stack further comprises an administrative layer that allows remote configuration and control of the hierarchical storage stack and further comprising:
 remotely accessing the administration layer in the server system through the network connection to configure the server system.   
     
     
         7 . The method of  claim 6 , further comprising:
 receiving in the administration layer a request to create a new data volume in the server system;   allocating the new data volume in the hierarchical storage stack; and   creating storage space for the new data volume by transferring data from the local data storage layer to the remote data storage layer.   
     
     
         8 . The method of  claim 6 , further comprising:
 receiving in the administration layer a request to restore a data volume;   copying a data volume snapshot index into the hierarchical storage stack to create a restored data volume, the data volume snapshot index referencing data in a remote server; and   copying data from the remote server as data in the restored data volume is requested by local users of the server system.   
     
     
         9 . The method of  claim 6 , further comprising periodically polling, by the administration layer, the local data storage layer and the remote data storage layer to generate statistics representing performance of the hierarchical storage stack. 
     
     
         10 . A system comprising:
 a processor;   a network interface;   a hierarchical storage stack for storing data comprising at least a local data storage layer for storing data locally in the system and a remote data storage layer that stores data with a remote data storage service; and   memory storing a set of computer-executable instructions that, when executed by the processor, cause the system to perform the operations of:   utilizing the local data storage layer as a read-ahead cache for the remote data storage layer by:
 identifying a selected data object of the remote data storage layer that is absent in the local data storage layer; and 
 before receiving an incoming request to access the selected data object, moving the selected data object from the remote data storage layer to the local data storage layer. 
   
     
     
         11 . The system of  claim 10 , wherein the selected data object is identified using heuristics to identify data that is likely to be requested soon. 
     
     
         12 . The system of  claim 10 , wherein the selected data object is accessed infrequently but a low latency response is needed when the data object is accessed. 
     
     
         13 . The system of  claim 10 , wherein the remote data storage service comprises a cloud-based virtual server. 
     
     
         14 . The system of  claim 10 , wherein the local data storage layer comprises a first local data storage layer that stores data in a raw format and a second local data storage layer that stores data in a format with duplicate data removed. 
     
     
         15 . The system of  claim 10 , further comprising a data volume in the hierarchical storage stack that will initially store data in the local data storage layer and later spill data to the remote data storage layer. 
     
     
         16 . The system of  claim 10 , wherein the hierarchical storage stack further comprises an administrative layer that allows remote configuration and control of the hierarchical storage stack and the operations further comprise:
 remotely accessing the administration layer in the system through the network connection to configure the system.   
     
     
         17 . A non-transitory computer-readable medium storing a set of computer-executable instructions that, when executed by a processor, cause a computing device to perform the operations of:
 installing a system comprising a hierarchical storage stack for storing data, the hierarchical storage stack comprising a local data storage layer for storing data locally in the system and a remote data storage layer that stores data with a remote data storage service; and   utilizing the local data storage layer as a read-ahead cache for the remote data storage layer by:
 identifying a selected data object of the remote data storage layer that is absent in the local data storage layer; and 
 before receiving an incoming request to access the selected data object, moving the selected data object from the remote data storage layer to the local data storage layer. 
   
     
     
         18 . The non-transitory computer-readable medium of  claim 17 , wherein the selected data object is identified using heuristics to identify data that is likely to be requested soon. 
     
     
         19 . The non-transitory computer-readable medium of  claim 17 , wherein the selected data object is accessed infrequently but a low latency response is needed when the data object is accessed. 
     
     
         20 . The non-transitory computer-readable medium of  claim 17 , wherein the system further comprises an administrative layer that allows remote configuration and control of the hierarchical storage stack and the operations further comprise:
 remotely accessing the administration layer in the system through a network connection to configure the system.