System and method for executing database operations based on a policy

Abstract

Disclosed are systems, devices, methods, and computer-readable media for performing various actions for bringing data stores into compliance with a policy. The actions include generating a global scan index (“scan index”) for SAS® software and using the scan index to handle data management operations. Unlike traditional B-tree indices that consume a larger quantity of resources to parse through data, the scan indices may include a table of three columns. A first column may include an indication of a search value, a second column may include an indication of what table(s) in the data store(s) include the requested value, and a third column may include an indication of the row number for the tables in column two in which the value resides. The actions further include batching requests to perform a data management operation on data of a certain category by employing the scan index.

The invention claimed is: 
     
       1. A system, comprising:
 one or more hardware processors; and 
 non-transitory memory storing instructions that, when executed by the one or more hardware processors, cause the one or more hardware processors to perform actions comprising:
 receiving a policy defining maintenance rules of data in a data store, wherein the policy comprises a string of alphanumeric characters and an additional string of alphanumeric characters to be adjusted, wherein the string of alphanumeric characters is different than the additional string of alphanumeric characters; 
 retrieving a global index in response to receiving the policy and based on the global index comprising the string of alphanumeric characters, wherein the global index indicates, in the data store, a row of a table containing the string of alphanumeric characters; 
 retrieving an additional global index in response to receiving the policy and based on the additional global index comprising the additional string of alphanumeric characters, wherein the additional global index indicates, in the data store, an additional row of the table containing the additional string of alphanumeric characters; 
 batching operations via, at a particular time, initiating and performing a search query on the table by scanning the row of the table for the string of alphanumeric characters according to the global index and scanning the additional row of the table for the additional string of alphanumeric characters according to the additional global index to identify a table entry containing the string of alphanumeric characters based on the row of the table indicated by the global index and to identify an additional table entry based on the additional row of the additional table indicated by the additional global index; and 
 adjusting the table entry and the additional table entry in accordance with the policy after identification of the table entry and the additional table entry by performing the search query. 
 
 
     
     
       2. The system of  claim 1 , wherein the actions comprise:
 performing an additional search query on an additional table to identify another table entry containing the string of alphanumeric characters based on a respective row of the additional table indicated by the global index and another additional table entry containing the additional string of alphanumeric characters based on a respective additional row of the additional table indicated by the additional global index; and 
 adjusting the another table entry and the another additional table entry in accordance with the policy after identification of the another table entry and the another additional table entry by performing the additional search query. 
 
     
     
       3. The system of  claim 1 , wherein the actions comprise:
 excluding one or more tables from the data store based on the one or more tables being received at a respective date that is outside of a period of time defined by the policy; and 
 from remaining tables of the data store, identifying a subset of tables comprising table entries associated with a member number. 
 
     
     
       4. The system of  claim 3 , wherein the actions comprise performing the search query on the table based on the table being a part of the subset of tables. 
     
     
       5. The system of  claim 1 , wherein the actions comprise:
 receiving a string of uncategorized alphanumeric characters; 
 determining whether each word in the string of uncategorized alphanumeric characters corresponds to an entry in a scoring table; 
 determining a category associated with each word in the string of uncategorized alphanumeric characters based on whether each word in the string of uncategorized alphanumeric characters corresponds to the entry in the scoring table; 
 assigning an overall category to the string of uncategorized alphanumeric characters based on the category associated with each word in the string of uncategorized alphanumeric characters; and 
 indexing the string of uncategorized alphanumeric characters based on the overall category. 
 
     
     
       6. The system of  claim 5 , wherein the actions comprise creating the global index comprising the string of alphanumeric characters based on indexing of the string of uncategorized alphanumeric characters. 
     
     
       7. The system of  claim 5 , wherein the overall category comprises an indication of a member number, a date of birth, an E-mail, a first name, a last name, an address, or a city. 
     
     
       8. The system of  claim 1 , wherein the global index is stored in less than 20 bytes. 
     
     
       9. The system of  claim 1 , wherein performing the search query comprises:
 accessing a plurality of tables of the data store based on a batching schedule, wherein the plurality of tables comprises the table indicated by the global index and the additional global index; 
 searching the plurality of tables based on the global index and the additional global index to find a plurality of table entries containing the string of alphanumeric characters and the additional string of alphanumeric characters, wherein the plurality of table entries comprises the table entry and the additional table entry; and 
 generating a new table of the plurality of table entries. 
 
     
     
       10. The system of  claim 1 , wherein the global index comprises an entry comprising the string of alphanumeric characters, and the entry comprises:
 a first indication of a member number; 
 a second indication of a date of birth; 
 a third indication of an E-mail; 
 a fourth indication of a name; 
 a fifth indication of an address; 
 a sixth indication of a city; or 
 any combination thereof. 
 
     
     
       11. The system of  claim 1 , wherein the policy corresponds to a state level regulation, a national regulation, an enterprise-wide guideline, or any combination thereof. 
     
     
       12. The system of  claim 1 , wherein the global index comprises an entry comprising binary integers representative of the string of alphanumeric characters. 
     
     
       13. A computer-implemented method for performing batched data management operations, the computer-implemented method comprising:
 receiving a policy defining maintenance rules of data in a data store, wherein the policy comprises a request to adjust requested table entries that each comprise a string of alphanumeric characters of a plurality of strings of alphanumeric characters or an additional string of alphanumeric characters of the plurality of strings of alphanumeric characters, wherein the string of alphanumeric characters is different than the additional string of alphanumeric characters; 
 retrieving a global index of a plurality of global indices in response to receiving the policy and based on the global index of the plurality of global indices comprising the string of alphanumeric characters of the plurality of strings of alphanumeric characters, wherein the global index of the plurality of global indices indicates, in the data store, a plurality of rows of a plurality of tables containing the string of alphanumeric characters, wherein the plurality of rows of the plurality of tables comprises a respective row of a table of the plurality of tables; 
 retrieving an additional global index of the plurality of global indices in response to receiving the policy and based on the additional global index of the plurality of global indices comprising the additional string of alphanumeric characters of the plurality of strings of alphanumeric characters, wherein the additional global index of the plurality of global indices indicates, in the data store, a plurality of additional rows of the plurality of tables containing the additional string of alphanumeric characters, wherein the plurality of additional rows of the plurality of tables comprises a respective additional row of the table of the plurality of tables; 
 batching operations via:
 at a particular time, initiating and performing a search query on the table of the plurality of tables to identify a table entry containing the string of alphanumeric characters and to identify an additional table entry containing the additional string of alphanumeric characters by scanning the respective row of the table of the plurality of tables indicated by the global index of the plurality of global indices and scanning the respective additional row of the table of the plurality of tables indicated by the additional global index of the plurality of global indices; and 
 adjusting the table entry and the additional table entry in accordance with the policy after identification of the table entry and the additional table entry by performing the search query. 
 
 
     
     
       14. The computer-implemented method of  claim 13 , comprising:
 identifying one or more tables received at a respective date that is outside of a period of time defined by the policy; 
 from remaining tables of the data store, identifying a subset of tables from the data store comprising an additional plurality of table entries associated with a member number; and 
 performing the search query on the plurality of tables based on the plurality of tables being a part of the subset of tables. 
 
     
     
       15. A non-transitory, computer-readable medium having computer-readable code stored thereon that, when executed by one or more processors, causes the one or more processors to perform operations comprising:
 receiving a policy defining maintenance rules of data in a data store, wherein the policy indicates an adjustment to requested table entries that each comprise a string of alphanumeric characters of a plurality of strings of alphanumeric characters or an additional string of alphanumeric characters of the plurality of strings of alphanumeric characters, wherein the string of alphanumeric characters is different than the additional string of alphanumeric characters; 
 retrieving a global index of a plurality of global indices in response to receiving the policy and based on the global index of the plurality of global indices comprising the string of alphanumeric characters of the plurality of strings of alphanumeric characters, wherein the global index of the plurality of global indices indicates, in the data store, a plurality of rows of a plurality of tables containing the plurality of strings of alphanumeric characters, wherein the plurality of rows of the plurality of tables comprises a respective row of a table of the plurality of tables; 
 retrieving an additional global index of the plurality of global indices in response to receiving the policy and based on the additional global index of the plurality of global indices comprising the additional string of alphanumeric characters of the plurality of strings of alphanumeric characters, wherein the additional global index of the plurality of global indices indicates, in the data store, a plurality of additional rows of the plurality of tables containing the additional string of alphanumeric characters, wherein the plurality of additional rows of the plurality of tables comprises a respective additional row of the table of the plurality of tables; 
 batching operations via:
 at a particular time, initiating and performing a search query on the table of the plurality of tables to identify a table entry containing the string of alphanumeric characters and to identify an additional table entry containing the additional string of alphanumeric characters by scanning the respective row of the table of the plurality of tables indicated by the global index of the plurality of global indices and scanning the respective additional row of the table of the plurality of tables indicated by the additional global index of the plurality of global indices; and 
 adjusting the table entry and the additional table entry in accordance with the policy after identification of the table entry and the additional table entry by performing the search query. 
 
 
     
     
       16. The non-transitory, computer-readable medium of  claim 15 , wherein the operations comprise:
 excluding one or more tables from the data store based on the one or more tables being received at a date that is outside of a period of time defined by the policy; and 
 from remaining tables of the data stores, identifying a first subset of tables comprising an additional plurality of table entries associated with a member number. 
 
     
     
       17. The non-transitory, computer-readable medium of  claim 16 , wherein the operations comprise:
 from the first subset of tables, identifying a second subset of tables comprising a respective plurality of additional table entries associated with a date-of-birth; and 
 performing the search query on the plurality of tables based on the plurality of tables being a part of the second subset of tables. 
 
     
     
       18. The non-transitory, computer-readable medium of  claim 17 , wherein the operations comprise, from the first subset of tables, identifying the second subset of tables based on a respective quantity of the respective plurality of additional table entries of each table of the second subset of tables exceeding a threshold quantity. 
     
     
       19. The non-transitory, computer-readable medium of  claim 15 , wherein performing the search query comprises:
 accessing the plurality of tables of the data store; 
 performing the search query on the plurality of tables by scanning the plurality of rows of the plurality of tables indicated by the plurality of global indices to find a plurality of table entries including the table entry; and 
 generating a new table of the plurality of table entries.