Systems and methods for processing electronic images based on digital biomarkers and genomic panels

Abstract

Systems and methods are disclosed for receiving one or more digital images associated with a tissue specimen, a related case, a patient, and/or a plurality of clinical information, determining one or more of a prediction, a recommendation, and/or a plurality of data for the one or more digital images using a machine learning system, the machine learning system having been trained using a plurality of training images, to predict a biomarker and a plurality of genomic panel elements, and determining, based on the prediction, the recommendation, and/or the plurality of data, whether to log an output and at least one visualization region as part of a case history within a clinical reporting system.

1 - 20 . (canceled) 
     
     
         21 . A computer-implemented method for processing an electronic image, comprising:
 determining, by a machine learning system, a prediction of a biomarker and a plurality of genomic panel elements, for one or more digital images;   generating, based on the prediction, one or more recommended treatment pathways;   determining, based on the prediction, whether to log an output and/or at least one visualization region; and   generating one or more displays of the one or more recommended treatment pathways through at least one of an overlay of at least one region of interest layered on top of the one or more digital images and a visualization of the one or more digital images with the prediction displayed and/or the one or more digital images without the prediction displayed.   
     
     
         22 . The computer-implemented method of  claim 21 , wherein the method further comprises integrating the one or more recommended treatment pathways and the visualization into a final diagnostic report. 
     
     
         23 . The computer-implemented method of  claim 21 , wherein the one or more recommended treatment pathways comprise a list of at least one recommended treatment pathway based on a predicted tumor region. 
     
     
         24 . The computer-implemented method of  claim 21 , wherein the one or more recommended treatment pathways comprise at least one of a drug treatment, a clinical trial, a success rate, and a location for treatment. 
     
     
         25 . The computer-implemented method of  claim 21 , wherein the method further comprises generating an option for a user to review the prediction or the visualization. 
     
     
         26 . The computer-implemented method of  claim 21 , wherein the visualization comprises digital immunohistochemistry or genomic panel results comprising a summary of digital tests run with at least one result. 
     
     
         27 . The computer-implemented method of  claim 21 , wherein the step of determining, by the machine learning system, the prediction comprises:
 receiving one or more digitized images of a pathology specimen, related information, clinical information, and patient information;   developing a system that stores and archives a plurality of images and a plurality of corresponding patient data; and   determining at least one predicted biomarker and at least one predicted genomic panel element, based on the plurality of images and the plurality of corresponding patient data.   
     
     
         28 . The computer-implemented method of  claim 27 , wherein the method further comprises converting one or more prediction value and at least one treatment pathway recommendation to a form readable by a user. 
     
     
         29 . The computer-implemented method of  claim 28 , wherein the method further comprises outputting the one or more prediction value and the at least one treatment pathway recommendation to a user interface. 
     
     
         30 . A system for processing an electronic image, the system comprising:
 at least one memory storing instructions; and   at least one processor configured to execute the instructions to perform operations comprising:   determining, by a machine learning system, a prediction of a biomarker and a plurality of genomic panel elements, for one or more digital images;   generating, based on the prediction, one or more recommended treatment pathways;   determining, based on the prediction, whether to log an output and/or at least one visualization region; and   generating one or more displays of the one or more recommended treatment pathways through at least one of an overlay of at least one region of interest layered on top of the one or more digital images and a visualization of the one or more digital images with the prediction displayed and/or the one or more digital images without the prediction displayed.   
     
     
         31 . The system of  claim 30 , the operations further comprising:
 generating a notification indicating that the prediction or the visualization for the one or more digital images is available.   
     
     
         32 . The system of  claim 30 , the operations further comprising:
 generating an option for a user to review the prediction or the visualization.   
     
     
         33 . The system of  claim 30 , the operations further comprising:
 integrating the one or more recommended treatment pathways and the visualization into a final diagnostic report.   
     
     
         34 . The system of  claim 30 , wherein the one or more recommended treatment pathways comprise a list of at least one recommended treatment pathway based on a predicted tumor region. 
     
     
         35 . The system of  claim 30 , wherein the one or more recommended treatment pathways comprise at least one of a drug treatment, a clinical trial, a success rate, and a location for treatment. 
     
     
         36 . The system of  claim 30 , wherein the recommendation of at least one treatment pathway is based on a plurality of clinical practice guidelines. 
     
     
         37 . The system of  claim 30 , wherein the step of determining the prediction comprises:
 receiving one or more digitized images of a pathology specimen, related information, clinical information, and patient information;   developing a system that stores and archives a plurality of images and a plurality of corresponding patient data;   determining at least one predicted biomarker and at least one predicted genomic panel element, based on the plurality of images and the plurality of corresponding patient data; and   converting one or more prediction value and at least one treatment pathway recommendation to a form readable by a user.   
     
     
         38 . The system of  claim 37 , the operations further comprising outputting the one or more prediction value and the at least one treatment pathway recommendation to a user interface. 
     
     
         39 . A non-transitory computer readable medium storing instructions that, when executed by a processor, cause the processor to perform operations, the operations comprising:
 determining, by a machine learning system, a prediction of a biomarker and a plurality of genomic panel elements, for one or more digital images;   generating, based on the prediction, one or more recommended treatment pathways;   determining, based on the prediction, whether to log an output and/or at least one visualization region; and   generating one or more displays of the one or more recommended treatment pathways through at least one of an overlay of at least one region of interest layered on top of the one or more digital images and a visualization of the one or more digital images with the prediction displayed and/or the one or more digital images without the prediction displayed.   
     
     
         40 . The computer readable medium of  claim 39 , wherein the operations further comprise integrating the one or more recommended treatment pathways and the visualization into a final diagnostic report.