Dynamic creation and configuration of partitioned index through analytics based on existing data population

Abstract

Partitioning of a monitored index commences upon receiving a trigger. Properties of the index are fetched and analyzed using a pipes analytics engine. A new partitioned index is generated and an alias is assigned to the new partitioned index. The alias is added to a partitioned index alias table.

1 - 7 . (canceled) 
     
     
         8 . A computer system for generating a partition of an index, comprising:
 a computer device having a processor and a tangible storage device, wherein the computer is attached to a first object; and   a program embodied on the storage device for execution by the processor, the program having a plurality of program instructions to:   monitor one or more properties of the index;   receive a trigger event, based on the monitoring, to partition the index;   fetch one or more properties of the index;   execute one or more analytics pipes, based on the fetching, to determine a dynamically generated partition configuration of the index; and   partition the index according to the dynamically generated partition configuration based on results of executing the one or more analytics pipes.   
     
     
         9 . The system of  claim 8 , wherein the program instructions to execute the one or more analytic pipes further comprise instructions to:
 execute the analytic pipe using a descriptive analytics engine.   
     
     
         10 . The system of  claim 8 , wherein the one or more analytics pipes use a single hypertext transfer protocol (HTTP). 
     
     
         11 . The system of  claim 8 , wherein the program instructions further comprise instructions to:
 receive a data set of an existing index;   generate an index alias of the existing index; and   aggregate the index alias and one or more additional index aliases in an alias table.   
     
     
         12 . The system of  claim 8 , wherein the index comprises data generated by a mobile device. 
     
     
         13 . The system of  claim 8 , wherein the dynamically generated partition configuration of the index is based on one or more of:
 determining a number of unique mobile devices generating data of the index;   determining a number of shards to generate based on a pre-defined data size limit; and   determining location(s) of one or more of the unique mobile devices and selecting search nodes for hosting shards containing data from the unique mobile devices, wherein the search nodes are selected based on their proximity to the determined location(s).   
     
     
         14 . A computer program product for generating a partition of an index, comprising a tangible storage device having program code embodied therewith, the program code executable by a processor of a computer to perform a method, the method comprising:
 monitoring, by the processor, properties of the index;   based on the monitoring, receiving, by the processor, a trigger event to partition the index;   fetching, by the processor, one or more properties of the index;   based on the fetching, executing, by the processor, one or more analytics pipes to determine, based on the fetched properties of the index, a dynamically generated partition configuration of the index; and   based on the executing, partitioning, by the processor, the index according to the dynamically generated partition configuration.   
     
     
         15 . The computer program product of  claim 14 , wherein executing the one or more analytic pipe comprises:
 executing, by the processor, the analytic pipe using a descriptive analytics engine.   
     
     
         16 . The computer program product of  claim 14 , wherein the one or more analytics pipes use a single hypertext transfer protocol (HTTP). 
     
     
         17 . The computer program product of  claim 14 , further comprising:
 receiving, by the processor, a data set of an existing index;   generating, by the processor, an index alias of the existing index; and   aggregating, by the processor, the index alias and one or more additional index aliases in an alias table.   
     
     
         18 . The computer program product of  claim 14 , wherein the index comprises data generated by a mobile device. 
     
     
         19 . The computer program product of  claim 14 , wherein the dynamically generated partition configuration of the index is based on one or more of:
 determining a number of unique mobile devices generating data of the index;   determining a number of shards to generate based on a pre-defined data size limit; and   determining location(s) of one or more of the unique mobile devices and selecting search nodes for hosting shards containing data from the unique mobile devices, wherein the search nodes are selected based on their proximity to the determined location(s).   
     
     
         20 . The computer program product of  claim 14 , wherein partitioning the index is performed atomically.