Disk usage growth prediction system

Abstract

Certain embodiments described herein relate to an improved disk usage growth prediction system. In some embodiments, one or more components in an information management system can determine usage status data of a given storage device, perform a validation check on the usage status data using multiple prediction models, compare validation results of the multiple prediction models to identify the best performing prediction model, generate a disk usage growth prediction using the identified prediction model, and adjust the available space of the storage device according to the disk usage growth prediction.

What is claimed is: 
     
         1 . A method of performing disk usage growth prediction, the method comprising:
 determining usage status data of one or more secondary storage devices storing secondary copies of primary data associated with one or more client computing devices;   for each one of a plurality of prediction models, performing a validation check using a portion of the usage status data;   comparing validation results corresponding to the plurality of prediction models to a remaining portion of the usage status data;   based on the comparison, selecting one of the plurality of prediction models;   using the selected prediction model, generating a disk usage growth prediction of the one or more secondary storage devices; and   based on the generated disk usage growth prediction, adjusting available capacity of the one or more secondary storage devices.   
     
     
         2 . The method of  claim 1 , further comprising:
 initiating a backup operation;   causing at least a portion of the primary data to be copied onto the one or more secondary storage devices;   polling the one or more secondary storage devices for the usage status data based at least on the portion of the primary data copied onto the one or more secondary storage devices;   updating the disk usage growth prediction of the one or more secondary storage devices storing the portion of the primary data copied onto the one or more secondary storage devices; and   further adjusting available capacity of the one or more secondary storage devices storing the portion of the primary data copied onto the one or more secondary storage devices.   
     
     
         3 . The method of  claim 1 , further comprising:
 initiating a deduplication operation;   causing deduplication data to be stored in the one or more secondary storage devices;   polling the one or more secondary storage devices for the usage status data based at least on the deduplication data;   updating the disk usage growth prediction of the one or more secondary storage devices storing the deduplication data; and   further adjusting available capacity of the one or more secondary storage devices storing the deduplication data.   
     
     
         4 . The method of  claim 1 , further comprising:
 generating index cache data for the secondary copies stored in the one or more secondary storage devices;   causing the index cache data to be stored in another storage device different from the one or more secondary storage devices;   polling said another storage device for usage status data based at least on the index cache data;   generating disk usage growth prediction of said another storage device storing the index cache data; and   adjusting available capacity of said another storage device storing the index cache data.   
     
     
         5 . The method of  claim 1 , further comprising:
 determining additional usage status data of the one or more secondary storage devices;   performing a subsequent validation check for the selected prediction model and not for other prediction modules of the plurality of prediction models;   comparing a result of the subsequent validation check to the additional usage status data; and   based on the comparison of the result to the to the additional usage status data, further adjusting available capacity of the one or more secondary storage devices.   
     
     
         6 . The method of  claim 1 , wherein the usage data comprises one or more of storage device maximum capacity, storage device current usage, storage device remaining space, storage device incremental usage associated with a predetermined time period, and storage device type. 
     
     
         7 . The method of  claim 1 , wherein comparing the validation results comprises calculating, for each validation result, a difference between the validation result and the remaining portion of the usage status data not used to perform the validation check. 
     
     
         8 . The method of  claim 1 , wherein the generated disk usage growth prediction comprises a time or a time period when the one or more secondary storage devices are expected to become full. 
     
     
         9 . The method of  claim 1 , wherein the generated disk usage growth prediction comprises an amount of time remaining until a time or a time period when the one or more secondary storage devices are expected to become full. 
     
     
         10 . The method of  claim 1 , further comprising modifying, prior to performing the validation check, the usage status data to add missing data to the usage status data or to remove anomalous data from the usage status data. 
     
     
         11 . A networked information management system configured to perform disk usage growth prediction, the networked information management system comprising:
 one or more client computing devices;   one or more primary storage devices configured to store primary data generated by the one or more client computing devices;   one or more secondary storage devices configured to store secondary copies of the primary data; and   a storage manager comprising physical hardware and configured to:
 determine usage status data of the one or more secondary storage devices; 
 for each one of a plurality of prediction models, perform a validation check using a portion of the usage status data; 
 compare validation results corresponding to the plurality of prediction models to a remaining portion of the usage status data; 
 based on the comparison, select one of the plurality of prediction models; 
 using the selected prediction model, generate a disk usage growth prediction of the one or more secondary storage devices; and 
 based on the generated disk usage growth prediction, adjust available capacity of the one or more secondary storage devices. 
   
     
     
         12 . The networked information management system of  claim 11 , wherein the storage manager is further configured to:
 initiate a backup operation;   cause at least a portion of the primary data to be copied onto the one or more secondary storage devices;   poll the one or more secondary storage devices for the usage status data based at least on the portion of the primary data copied onto the one or more secondary storage devices;   update the disk usage growth prediction of the one or more secondary storage devices storing the portion of the primary data copied onto the one or more secondary storage devices; and   further adjust available capacity of the one or more secondary storage devices storing the portion of the primary data copied onto the one or more secondary storage devices.   
     
     
         13 . The networked information management system of  claim 11 , wherein the storage manager is further configured to:
 initiate a deduplication operation;   cause deduplication data to be stored in the one or more secondary storage devices;   poll the one or more secondary storage devices for the usage status data based at least on the deduplication data;   update the disk usage growth prediction of the one or more secondary storage devices storing the deduplication data; and   further adjust available capacity of the one or more secondary storage devices storing the deduplication data.   
     
     
         14 . The networked information management system of  claim 11 , wherein the storage manager is further configured to:
 generate index cache data for the secondary copies stored in the one or more secondary storage devices;   cause the index cache data to be stored in another storage device different from the one or more secondary storage devices;   poll said another storage device for usage status data based at least on the index cache data;   generate disk usage growth prediction of said another storage device storing the index cache data; and   adjust available capacity of said another storage device storing the index cache data.   
     
     
         15 . The networked information management system of  claim 11 , wherein the storage manager is further configured to:
 determine additional usage status data of the one or more secondary storage devices;   perform a subsequent validation check for the selected prediction model and not for other prediction modules of the plurality of prediction models;   compare a result of the subsequent validation check to the additional usage status data; and   based on the comparison of the result to the to the additional usage status data, further adjust available capacity of the one or more secondary storage devices.   
     
     
         16 . A non-transitory computer-readable medium comprising instructions that, when executed by a computing device comprising one or more processors and computer memory, cause the computing device to perform operations comprising:
 determining usage status data of one or more secondary storage devices storing secondary copies of primary data associated with one or more client computing devices;   for each one of a plurality of prediction models, performing a validation check using a portion of the usage status data;   comparing validation results corresponding to the plurality of prediction models to a remaining portion of the usage status data;   based on the comparison, selecting one of the plurality of prediction models;   using the selected prediction model, generating a disk usage growth prediction of the one or more secondary storage devices; and   based on the generated disk usage growth prediction, adjusting available capacity of the one or more secondary storage devices.   
     
     
         17 . The non-transitory computer-readable medium of  claim 16 , wherein the operations further comprise:
 initiating a backup operation;   causing at least a portion of the primary data to be copied onto the one or more secondary storage devices;   polling the one or more secondary storage devices for the usage status data based at least on the portion of the primary data copied onto the one or more secondary storage devices;   updating the disk usage growth prediction of the one or more secondary storage devices storing the portion of the primary data copied onto the one or more secondary storage devices; and   further adjusting available capacity of the one or more secondary storage devices storing the portion of the primary data copied onto the one or more secondary storage devices.   
     
     
         18 . The non-transitory computer-readable medium of  claim 16 , wherein the operations further comprise:
 initiating a deduplication operation;   causing deduplication data to be stored in the one or more secondary storage devices;   polling the one or more secondary storage devices for the usage status data based at least on the deduplication data;   updating the disk usage growth prediction of the one or more secondary storage devices storing the deduplication data; and   further adjusting available capacity of the one or more secondary storage devices storing the deduplication data.   
     
     
         19 . The non-transitory computer-readable medium of  claim 16 , wherein the operations further comprise:
 generating index cache data for the secondary copies stored in the one or more secondary storage devices;   causing the index cache data to be stored in another storage device different from the one or more secondary storage devices;   polling said another storage device for usage status data based at least on the index cache data;   generating disk usage growth prediction of said another storage device storing the index cache data; and   adjusting available capacity of said another storage device storing the index cache data.   
     
     
         20 . The non-transitory computer-readable medium of  claim 16 , wherein the operations further comprise:
 determining additional usage status data of the one or more secondary storage devices;   performing a subsequent validation check for the selected prediction model and not for other prediction modules of the plurality of prediction models;   comparing a result of the subsequent validation check to the additional usage status data; and   based on the comparison of the result to the to the additional usage status data, further adjusting available capacity of the one or more secondary storage devices.