Method and system for search engine indexing and searching using the index

Abstract

Data indexing includes receiving data from a data source; classifying the data into one of a plurality of categories according to a predetermined data classification criteria; establishing a corresponding relationship between the data and an index associated with the data, the index having a preset maximum capacity; and recording the relationship between the data and the index. The index is one of a plurality of indices, and each of the plurality of indices is exclusively written by an index writing device.

What is claimed is: 
     
         1 . (canceled) 
     
     
         2 . A system, comprising:
 a classification module to:
 receive data to be indexed from a data source; 
 classify the data into a category of a plurality of categories according to a predetermined data classification criteria; 
 establish a corresponding relationship between the data and an index associated with the category, wherein the index is stored by an index storage module that is connected to the classification module; and 
 record the relationship between the data and the index, wherein the index is configured to be written by a corresponding index writing device, wherein to record the relationship between the data and the index comprises to:
 store at least a portion of the data in a file associated with the index; and 
 store an identifier associated with the index and an identifier associated with the corresponding index writing device in at least a portion of the file associated with the index. 
 
   
     
     
         3 . The system of  claim 2 , wherein the system further comprises a search module to:
 receive a search query;   determine an index in a plurality of indices that corresponds to the received search query; and   output stored data associated with the determined index.   
     
     
         4 . The system of  claim 2 , wherein the category is associated with a number of indices that is determined based at least in part on a capacity of the category and a preset maximum capacity of the index. 
     
     
         5 . The system of  claim 2 , wherein to establish the corresponding relationship between the data and the index comprises to label a plurality of indices associated with the category with consecutive positive integers. 
     
     
         6 . The system of  claim 2 , wherein:
 the index writing device is one of a plurality of index writing devices; and   wherein to record the relationship between the data and the index comprises to:
 label the plurality of index writing devices with consecutive positive integers; 
 divide a serial number of the index by the number of the index writing devices to obtain a remainder value; and 
 associate the data and the corresponding index writing device that has a serial number that is the same as the remainder value. 
   
     
     
         7 . The system of  claim 2 , wherein to classify the data into the category of the plurality of categories is based at least in part on a property of the data. 
     
     
         8 . The system of  claim 2 , wherein the file and the data are stored in a storage device. 
     
     
         9 . The system of  claim 2 , wherein the classification module is further to select the index associated with the category including to:
 assign a value to the data;   divide the value of the data by a number of indices associated with the category to obtain a remainder value; and   select the index associated with the category that has a serial number that is the same as the remainder value.   
     
     
         10 . A method, comprising:
 receiving data to be indexed from a data source;   classifying the data into a category of a plurality of categories according to a predetermined data classification criteria;   establishing a corresponding relationship between the data and an index associated with the category; and   recording the relationship between the data and the index, wherein the index is configured to be written by a corresponding index writing device, wherein recording the relationship between the data and the index comprises:
 storing at least a portion of the data in a file associated with the index; and 
 storing an identifier associated with the index and an identifier associated with the corresponding index writing device in at least a portion of the file associated with the index. 
   
     
     
         11 . The method of  claim 10 , further comprising:
 receiving a search query;   determining an index in a plurality of indices that corresponds to the received search query; and   outputting stored data associated with the determined index.   
     
     
         12 . The method of  claim 10 , wherein the category is associated with a number of indices that is determined based at least in part on a capacity of the category and a preset maximum capacity of the index. 
     
     
         13 . The method of  claim 10 , wherein establishing the corresponding relationship between the data and the index comprises labeling a plurality of indices associated with the category with consecutive positive integers. 
     
     
         14 . The method of  claim 10 , wherein:
 the index writing device is one of a plurality of index writing devices; and   wherein recording the relationship between the data and the index comprises:
 labeling the plurality of index writing devices with consecutive positive integers; 
 dividing a serial number of the index by the number of the index writing devices to obtain a remainder value; and 
 associating the data and the corresponding index writing device that has a serial number that is the same as the remainder value. 
   
     
     
         15 . The method of  claim 10 , wherein classifying the data into the category of the plurality of categories is based at least in part on a property of the data. 
     
     
         16 . The method of  claim 10 , wherein the file and the data are stored in a storage device. 
     
     
         17 . The method of  claim 10 , further comprising selecting the index associated with the category by:
 assigning a value to the data;   dividing the value of the data by a number of indices associated with the category to obtain a remainder value; and   selecting the index associated with the category that has a serial number that is the same as the remainder value.   
     
     
         18 . A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
 receiving data to be indexed from a data source;   classifying the data into a category of a plurality of categories according to a predetermined data classification criteria;   establishing a corresponding relationship between the data and an index associated with the category; and   recording the relationship between the data and the index, wherein the index is configured to be written by a corresponding index writing device, wherein recording the relationship between the data and the index comprises:
 storing at least a portion of the data in a file associated with the index; and 
 storing an identifier associated with the index and an identifier associated with the corresponding index writing device in at least a portion of the file associated with the index.