Data validation system

Abstract

A validation system and method are provided that examine data for use in tracking and/or generating an action plan. Data is received and stored at an implementation data store from production data sources. Evaluation rules are applied to the data by a data storage system. The evaluation rules are applied by running previously created scripts of commands of the data storage system. Applying the evaluation rules to the one or more sets of the data outputs a deviation measure for at least one of the sets of the data. The deviation measure and a restricted list of defined validation decisions is presented to an analyst for the data. A selected validation decision is received, and the data is validated for use in the action plan, rejected for use in the action plan, or identified as requiring additional analysis before being validated for use in the action plan.

What is claimed is: 
     
       1. A method for validating data for use in one or more of tracking or generating an action plan, the method comprising:
 receiving the data at an implementation data store from one or more production data sources via one or more computerized communication networks; 
 storing the data in the implementation data store using a data storage system; 
 applying evaluation rules to one or more sets of the data in the implementation data store, the evaluation rules applied to the one or more sets of the data by running previously created scripts of commands of the data storage system, wherein applying the evaluation rules to the one or more sets of the data outputs a deviation measure for at least one of the sets of the data, the deviation measure indicating whether the one or more sets of the data are legitimately entered with contents of the data being intentionally set to accurate values or whether the one or more sets of the data are invalid with the contents of the data being unintentionally set to inaccurate values; 
 presenting, to an analyst, the deviation measure and a restricted list of defined validation decisions for the one or more sets of the data; 
 receiving a selected validation decision in the restricted list from the analyst; and 
 one or more of validating the one or more sets of the data for use in the action plan, rejecting the one or more sets of the data for use in the action plan, or identifying the one or more sets of the data as requiring additional analysis before validating the one or more sets of the data for use in the action plan. 
 
     
     
       2. The method of  claim 1 , wherein the data storage system is one or more of a relational data storage system, a document storage system, or an object database system. 
     
     
       3. The method of  claim 1 , wherein the analyst is a human being. 
     
     
       4. The method of  claim 1 , wherein the analyst is an artificial intelligence computerized system. 
     
     
       5. The method of  claim 1 , wherein the selected validation decision is received from the analyst having one or more of a training level or an experience level below a designated level associated with writing the previously created scripts of the commands. 
     
     
       6. The method of  claim 1 , wherein the data includes one or more of demographic data, electronic medical record (EMR) encounter data, medical claim data, pharmacy claim data, lab result data, medical metric data, admit data, discharge data, or transfer data for at least one patient. 
     
     
       7. The method of  claim 1 , wherein the one or more production data sources include one or more databases at one or more medical offices, medical clinics, pharmacies, laboratories, educational entities, or financial institutions. 
     
     
       8. The method of  claim 1 , wherein the data is directly received at the implementation data store from the one or more production data sources without modification of the data. 
     
     
       9. The method of  claim 1 , further comprising
 changing one or more portions of the data within the intermediate computer server to one or more of normalize or conform the data to one or more requirements of the data storage system. 
 
     
     
       10. The method of  claim 1 , wherein the evaluation rules are applied to the one or more sets of the data and the deviation measure is presented to the analyst without revealing protected information in the data to the analyst. 
     
     
       11. The method of  claim 1 , wherein applying the evaluation rules to the one or more sets of the data automatically occurs based on a designated schedule. 
     
     
       12. The method of  claim 1 , further comprising:
 determining when one or more data-loading events occur as the data is received at the implementation data store, 
 wherein applying the evaluation rules to the one or more sets of the data automatically occurs based on occurrence of at least one of the data-loading events. 
 
     
     
       13. The method of  claim 1 , wherein the restricted list of defined validation decisions includes a pass decision indicating that the deviation measure of the one or more sets of the data conformed to a limit, a fail decision indicating that the deviation measure did not conform to the limit, or an indeterminate decision indicating that the analyst was unable to determine whether the deviation measure conformed or did not conform to the limit. 
     
     
       14. The method of  claim 13 , further comprising:
 responsive to receiving one or more of the fail decision or the indeterminate decision, receiving identifying data to be appended to the one or more sets of the data based on input provided by the analyst, the identifying data representing one or more of: 
 the evaluation rules applied to the one or more sets of the data, or 
 a proposed solution operation to be used to modify the one or more sets of the data or upcoming data to avoid the fail decision on the one or more sets of the data or the upcoming data. 
 
     
     
       15. The method of  claim 1 , further comprising:
 associating evaluation rule data with the one or more sets of the data responsive to rejecting the one or more sets of the data; and 
 communicating an identifier of the one or more sets of the data to a higher-level reviewer responsive to rejecting the one or more sets of the data, 
 wherein the higher-level reviewer has one or more of a training level or an experience level above a designated level associated with writing the previously created scripts. 
 
     
     
       16. The method of  claim 1 , further comprising:
 responsive to rejecting the one or more sets of the data, communicating a message that directs a stop to loading of one or more additional sets of the data from a first production data source of the one or more production data sources, wherein the first production data source is associated with the one or more sets of the data that were rejected. 
 
     
     
       17. The method of  claim 1 , wherein the one or more sets of the data are used in the action plan to determine one or more additional medical treatment operations to perform in connection with at least one patient responsive to validating the one or more sets of the data for use in the action plan. 
     
     
       18. A data validation system comprising:
 an implementation data store configured to receive and store data from one or more production data sources via one or more computerized communication networks, the implementation data store configured to receive the data from the one or more production data sources via an intermediate computer server that modifies one or more portions of the data to one or more of normalize or conform the data to one or more requirements of the data storage system prior to the implementation data store receiving the data; and 
 one or more processors configured to direct a data storage system to apply evaluation rules to one or more sets of the data in the implementation data store, the evaluation rules applied to the one or more sets of the data by running previously created scripts of commands of the data storage system, wherein applying the evaluation rules to the one or more sets of the data outputs a deviation measure for at least one of the sets of the data, 
 wherein the one or more processors also are configured to direct a user device to present, to an analyst, the deviation measure and a restricted list of defined validation decisions for the one or more sets of the data, the one or more processors also configured to receive a selected validation decision in the restricted list from the analyst and to one or more of validate the one or more sets of the data for use in an action plan, reject the one or more sets of the data for use in the action plan, or identify the one or more sets of the data as requiring additional analysis before validating the one or more sets of the data for use in the action plan. 
 
     
     
       19. The system of  claim 18 , wherein the data storage system is one or more of a relational data storage system, a document storage system, or an object database system. 
     
     
       20. A tangible and non-transitory computer readable storage medium comprising one or more sets of instructions that, while implemented, direct one or more processors to:
 receive data at an implementation data store from one or more production data sources via one or more computerized communication networks, the data received at the implementation data store from the one or more production data sources via an intermediate computer server that modifies one or more portions of the data to one or more of normalize or conform the data to one or more requirements of the data storage system prior to the implementation data store receiving the data; 
 store the data in the implementation data store using a data storage system; 
 apply evaluation rules to one or more sets of the data in the implementation data store, the evaluation rules applied to the one or more sets of the data by running previously created scripts of commands of the data storage system, wherein applying the evaluation rules to the one or more sets of the data outputs a deviation measure for at least one of the sets of the data; 
 present, to an analyst, the deviation measure and a restricted list of defined validation decisions for the one or more sets of the data; 
 receive a selected validation decision in the restricted list from the analyst; and 
 one or more of validate the one or more sets of the data for use in an action plan, reject the one or more sets of the data for use in the action plan, or identify the one or more sets of the data as requiring additional analysis before validating the one or more sets of the data for use in the action plan.