Information Source Agent and Computer Program Product for Distributed Data Storage and Management Using Content Signatures

Abstract

Information source agent and computer program product for distributed content storage and management using content signatures that use file identicality properties are provided. An information source agent is provided that includes a an information source collection agent for computing, gathering, or transporting file data information through the use of a content signature generator and content signature comparator, an information source modification agent that modifies files located on the information source client, and an agent controller to manage the operation of the information source collection agent.

1 . An information source agent residing within an information source client, comprising:
 an information source collection agent, on a computing device, configured to process file data information, wherein the information source collection agent comprises:
 a content signature generator configured to generate a content signature for files created, modified or received by the information source client; and 
 a content signature comparator configured to compare content signatures of two or more files created, modified or received by the information source client; 
   an information source modification agent, on the computing device, configured to modify files located on the information source client; and   an agent controller, on the computing device, coupled to the information source collection agent and to the information source modification agent, wherein the agent controller is configured to control operation of the information source collection agent and the information source modification agent and is configured to interface with at least one external source.   
     
     
         2 . The information source agent of  claim 1 , further comprising an indexing interface configured to transmit the content signature for the files to a storage system. 
     
     
         3 . The information source agent of  claim 1 , wherein the files include a data file, application file, system file, or a programmable ROM file. 
     
     
         4 . The information source agent of  claim 1 , wherein the content signature is a unique file identifier generated by hashing using SHA-1, MD2, MD4, MD5, HAVAL, RIPEMD-128, RIPEMD-256, RIPEMD-160, RIPEMD-320, Tiger, SHA-2, SHA-224, SHA-256, SHA-384, and SHA-512, Panama, or Whirlpool algorithms. 
     
     
         5 . The information source agent of  claim 1 , further comprising:
 a content signature applications module, on the computing device, that includes an application that uses file content signatures to control files based on file identicality; and   a set of content signature registries, on the computing device, that include lists of content signatures to support a content signature application.   
     
     
         6 . The information source agent of  claim 5 , wherein the set of content signature registries includes a blocked file content signature registry, a pornographic file content signature registry, a copyright file content signature registry, a confidential document content signature registry or a classified document content signature registry. 
     
     
         7 . The information source agent of  claim 1 , wherein the information source modification agent is configured to modify files located on the information source client by replacing an outdated file with a current version of the outdated file, deleting the outdated file, marking the outdated file in a manner visible to other programs, or by replacing the outdated file with a Unix symbolic link or a Windows short cut. 
     
     
         8 . The information source agent of  claim 1 , wherein the external source is a policy enforcement system, a virus checker, a malware checker or an interactive operator console. 
     
     
         9 . An information source agent, comprising:
 an information source collection agent, on a computing device, that comprises,
 a content signature generator configured to generate a content signature for a currently created or modified information source file; and 
 a content signature comparator configured to compare the content signature of the currently created or modified information source file with content signatures of previously created or modified information source files; 
   a modification agent, on the computing device, configured to modify information source files; and   an agent controller, on the computing device, coupled to the information source collection agent and the modification agent and configured to control their operation.   
     
     
         10 . The information source agent of  claim 9 , wherein the information source collection agent further comprises:
 a screening element coupled to the content signature generator and configured to determine whether the currently created or modified information source file should be transmitted to storage;   an indexing interface configured to transmit the content signature generated by the content signature generator to the storage; and   an activity monitor configured to receive information about file activity of the currently created or modified information source file.   
     
     
         11 . The information source agent of  claim 10 , wherein:
 the activity monitor is configured to receive information about information source file activity, including creation, usage, modification, renaming, or deletion of the currently created or modified information source file, or persons using the currently created or modified information source file;   the activity monitor is further configured to receive information about intermediate content conditions of the currently created or modified information source file between times when the currently created or modified information source file is backed up; and   the currently created or modified information source file includes a data file, application file, system file, or a programmable ROM file.   
     
     
         12 . The information source agent of  claim 9 , further comprising an indexing interface that is configured to transmit the content signature for the currently created or modified information source file to storage. 
     
     
         13 . The information source agent of  claim 9 , wherein the content signature comparator is configured to process the content signature, wherein the content signature is a unique file identifier generated by a hashing function. 
     
     
         14 . The information source agent of  claim 13 , wherein the hashing function comprises the SHA-1, MD2, MD4, MD5, HAVAL, RIPEMD-128, RIPEMD-256, RIPEMD-160, RIPEMD-320, Tiger, SHA-2, SHA-224, SHA-256, SHA-384, and SHA-512, Panama, and Whirlpool algorithms. 
     
     
         15 . The information source agent of  claim 9 , further comprising:
 a content signature applications module that includes an application configured to use file content signatures to control files based on file identicality; and   a set of content signature registries that includes lists of content signatures to support a content signature application.   
     
     
         16 . The information source agent of  claim 15 , wherein the set of content signature registries includes a blocked file content signature registry, a pornographic file content signature registry, a copyright file content signature registry, a confidential document content signature registry or a classified document content signature registry. 
     
     
         17 . The information source agent of  claim 9 , wherein the information source modification agent is configured to modify a file located on the information source client by:
 replacing the file, in response to determining that the file is outdated, with a current version of the file,   deleting the file,   marking the file in a manner visible to other programs, or   by replacing the file with a Unix symbolic link or a Windows short cut.   
     
     
         18 . A tangible computer readable medium having stored thereon in digital form computer-executable instructions that, in response to execution by a computing device, cause the computing device to perform operations, comprising:
 computing, gathering or transporting file data information;   generating a content signature for a currently created, modified, or received information source file, the file being created, modified, or received by an information source client;   comparing the content signature of the currently created, modified, or received information source file with content signatures of previously created or modified information source files;   modifying previously created or modified information source files;   managing the operation of the instructions for computing, gathering or transporting and the instructions for modifying previously created or modified information source files; and   interfacing with an external source.   
     
     
         19 . The tangible computer readable medium of  claim 18 , further comprising instructions for transmitting the content signature for each currently created, modified, or received information source file to a data management and storage system. 
     
     
         20 . The tangible computer readable medium of  claim 18 , wherein the instructions for modifying previously created or modified information source files further comprise instructions for replacing an outdated file with a current version of the file, deleting the file, marking the file in a manner visible to other programs, or replacing the file with a Unix symbolic link or a Windows short cut.