Transforming unstructured patient data streams using schema mapping and concept mapping with quality testing and user feedback mechanisms

Abstract

A method includes receiving unstructured data; processing the unstructured data to generate corresponding structured records; validating the structured patient records using quality tests; causing errors incomplete information to be displayed; and receiving a revision to the unstructured patient data. A computing system includes a processor; and a memory having stored thereon instructions that, when executed by processor, cause the computing system to: receive unstructured data; process the unstructured data to generate corresponding structured records; validate the structured patient records using quality tests; cause errors incomplete information to be displayed; and receive a revision to the unstructured patient data. A computer-readable medium includes instructions that, when executed by a processor, cause a computer to: receive unstructured data; process the unstructured data to generate corresponding structured records; validate the structured patient records using quality tests; cause errors incomplete information to be displayed; and receive a revision to the unstructured patient data.

What is claimed is: 
     
         1 . A computer-implemented method of performing improved automated quality assurance testing of structured patient data based on transformed unstructured data streams, the method comprising:
 (i) receiving, via one or more electronic data streams, unstructured patient data;   (ii) processing, via one or more processors, the unstructured patient data to generate corresponding structured patient records by performing a schema mapping and a concept mapping;   (iii) after processing the unstructured patient data, validating the structured patient records generated by the schema mapping and the concept mapping, by performing, via one or more processors, at least one data quality test on the structured patient records to identify one or more errors or instances of incomplete information in the structured patient records;   (iv) causing, via one or more processors, an indication of the identified errors or instances of incomplete information to be displayed on a display device accessible by a user; and   (v) receiving, one or more processors, a revision to the unstructured patient data from the user via a computing device accessible to the user.   
     
     
         2 . The computer-implemented method of  claim 1 , further comprising:
 repeating steps (ii)-(v) until one or more of the structured patient records satisfies a threshold for accuracy.   
     
     
         3 . The computer-implemented method of  claim 2 , further comprising:
 generating, via one or more processors, a digital abstraction of a patient record when the threshold for accuracy is not met.   
     
     
         4 . The computer-implemented method of  claim 1 , wherein the electronic data streams include JavaScript Object Notation-formatted data. 
     
     
         5 . The computer-implemented method of  claim 1 , wherein the unstructured patient data includes at least one of: (i) patient demographics data, (ii) diagnosis data, (iii) treatments data, (iv) outcomes data, (v) genetic testing data, (vi) labs data, or other (vii) patient data. 
     
     
         6 . The computer-implemented method of  claim 1 , wherein processing the unstructured patient data to generate structured patient records includes processing the unstructured patient data to identify medical ontological terms within the unstructured patient data includes processing the unstructured patient data using natural language processing to identify medical ontological terms within the unstructured patient data. 
     
     
         7 . The computer-implemented method of  claim 1 ,
 wherein performing the schema mapping includes determining a mapping between a plurality of data elements and a plurality of data values within a data schema and the unstructured patient data;   wherein the plurality of data elements includes one or more clinical and/or phenotypic data attributes;   wherein the plurality of data values includes values extracted from the unstructured patient data corresponding to respective ones of the plurality of data elements; and   wherein the data schema includes semantic relationship information describing correspondence of respective ones of the plurality of data elements to respective ones of the plurality of the data values.   
     
     
         8 . The computer-implemented method of  claim 1 , 
 wherein performing the concept mapping includes determining a mapping between a data model and one or more medical concepts included in the unstructured patient data, by identifying and processing one or more source data fields and attributes in the unstructured patient data.   
     
     
         9 . The computer-implemented method of  claim 1 , further comprising:
 processing, via one or more processors, at least a portion of the structured patient records to identify one or more clinical attributes; and   determining, based on the clinical attributes, whether to include at least one of the structured patient records corresponding to the at least the portion of the structured patient records in a clinical trial.   
     
     
         10 . The computer-implemented method of  claim 9 , further comprising:
 determining whether to include the at least the one of the structured patient records corresponding to the at least the portion of the structured patient records in the clinical trial based on the at least one data quality test.   
     
     
         11 . The computer-implemented method of  claim 1 , wherein performing the at least one data quality test on the structured patient records to identify one or more errors or one or more instances of incomplete information includes processing the structured patient records using (i) a recursive algorithm (ii) an iterative algorithm or (iii) a conflict resolution procedure. 
     
     
         12 . The computer-implemented method of  claim 11 , further comprising:
 generating an indication of support of the at least one data quality test based on the processing of the structured patient records using the recursive algorithm; or   generating a modification of the at least one data quality test based on the processing of the structured patient records using the recursive algorithm.   
     
     
         13 . The computer-implemented method of  claim 1 ,
 wherein the at least one data quality test is a genetic testing test including molecular variant criteria, and further comprising:   identifying a gene and a type of molecular variant of the gene.   
     
     
         14 . The computer-implemented method of  claim 1 , wherein the method is performed in response to detecting at least one trigger event. 
     
     
         15 . The computer-implemented method of  claim 14 , wherein detecting the at least the one trigger event includes:
 (i) detecting, via one or more processors, an on-demand request;   (ii) detecting, via one or more processors, a new software code commit;   (iii) detecting, via one or more processors, an application build phase;   (iv) detecting, via one or more processors, receipt of new data;   (vi) detecting, via one or more processors, ingesting of data across a source or a stream;   (vii) detecting, via one or more processors, a sufficient inter-rater or intra-rater reliability scoring system;   (viii) detecting, via one or more processors, a completion of a case abstraction and/or a quality assurance activity;   (ix) detecting, via one or more processors, a bulk initiation of evaluation of multiple structured patient records once all have been completed; or   (x) detecting, via one or more processors, a real-time analysis during creation of a patient note or other patient data.   
     
     
         16 . The computer-implemented method of  claim 14 , further comprising:
 appending the at least the one trigger event to a continuously growing set of stream-specific validations, warnings and errors monitored by administrators.   
     
     
         17 . The computer-implemented method of  claim 1 , further comprising:
 training, via one or more processors, one or more machine learning models based on the structured patient records.   
     
     
         18 . The computer-implemented method of  claim 1 , further comprising:
 generating, via one or more processors, a definitive clinical record for one or more patients.   
     
     
         19 . A computing system, comprising:
 one or more processors; and   one or more memories having stored thereon instructions that, when executed by one or more processors, cause the computing system to: 
 (i) receive, via one or more electronic data streams, unstructured patient data; 
 (ii) process, via the one or more processors, the unstructured patient data to generate corresponding structured patient records by performing a schema mapping and a concept mapping; 
 (iii) after processing the unstructured patient data, validate the structured patient records generated by the schema mapping and the concept mapping, by performing, via the one or more processors, at least one data quality test on the structured patient records to identify one or more errors or instances of incomplete information in the structured patient records; 
 (iv) cause, via the one or more processors, an indication of the identified errors or instances of incomplete information to be displayed on a display device of accessible by a user; and 
 (v) receive, via the one or more processors, a revision to the unstructured patient data from the user via a computing device accessible to the user. 
   
     
     
         20 . A computer-readable medium having stored thereon instructions that, when executed by one or more processors, cause a computer to:
 (i) receive, via one or more electronic data streams, unstructured patient data;   (ii) process, via one or more processors, the unstructured patient data to generate corresponding structured patient records by performing a schema mapping and a concept mapping;   (iii) after processing the unstructured patient data, validate the structured patient records generated by the schema mapping and the concept mapping, by performing, via one or more processors, at least one data quality test on the structured patient records to identify one or more errors or instances of incomplete information in the structured patient records;   (iv) cause, via one or more processors, an indication of the identified errors or instances of incomplete information to be displayed on a display device of accessible by a user; and   (v) receive, via one or more processors, a revision to the unstructured patient data from the user via a computing device accessible to the user.