Self-correcting method for annotation of data pool using feedback mechanism

Abstract

A method ( 200 ) of converting a flowchart ( 110 ) to a structured electronic representation ( 116 ) of the flowchart includes: identifying, in an image ( 108 ) of the flowchart, a plurality of shapes ( 112 ) corresponding to flowchart blocks of the flowchart; identifying arrows ( 114 ) defining flow paths between the flowchart blocks in the image including identifying flowchart blocks connected by the arrows and their directionality; identifying text labels and their locations in the image and determining text content of the text labels; associating the text labels with flowchart blocks or defined flow paths based on locations of the text labels, flowchart blocks, and arrows; and generating the structured electronic representation of the flowchart based on the flowchart blocks, the flow paths, and the text labels. A structure of the structured electronic representation is determined at least based at least on the flow paths between the flowchart blocks of the image.

1 . A monitoring device for generating maintenance alerts, the monitoring device comprising:
 a display;   an electronic processor operatively connected with the display; and   a non-transitory storage medium storing instructions readable and executable by the electronic processor to perform a monitoring method for generating maintenance alerts, the monitoring method comprising:
 generating decision rules for classifying medical imaging device log data based on whether parameter values of operating parameters of medical imaging device components identified by component identifications (component IDs) in the log data are within operating parameter ranges for the respective operating parameters wherein the operating parameter ranges for the respective operating parameters are extracted from electronic medical imaging device manuals; 
 applying the decision rules to log data generated by a monitored medical imaging device to detect out-of-range log data generated by the monitored medical imaging device; and 
 controlling the display to present maintenance alerts in response to the detected out-of-range log data wherein the maintenance alerts are associated with component IDs contained in the detected out-of-range log data. 
   
     
     
         2 . The monitoring device of  claim 1 , wherein the monitoring method further comprises:
 determining accuracy of the presented maintenance alerts based on feedback extracted from a service log of the monitored medical imaging device; and   updating the decision rules based on the determined accuracy of the presented maintenance alerts.   
     
     
         3 . The monitoring device of  claim 2 , wherein accuracy of a presented maintenance alert is determined based on feedback extracted from the service log of the monitored medical imaging device over a time interval extending from a time of presentation of the maintenance alert to an end time dependent upon a mean time to failure (MTTF) of the medical imaging device component identified by the component ID associated with the maintenance alert. 
     
     
         4 . The monitoring device of  claim 2 , wherein the generating of the decision rules includes identifying component IDs in the medical imaging device manuals using a named entity recognition (NER) algorithm. 
     
     
         5 . The monitoring device of  claim 4 , wherein the generating of the decision rules further includes:
 parsing text and tables of the electronic medical imaging device manuals to delineate semantic units including at least sentences, list items, and table rows;   identifying operating parameters by identifying numeric values and parameter terms that are connected by linking terms or symbols indicative of equality or inequality and associating operating parameters identified by the parameter terms with medical imaging device components whose component IDs occur in the same semantic units as the parameter terms; and   determining operating parameter ranges associated with the identified operating parameters based on the numeric values and the equalities or inequalities indicated by the linking terms or symbols.   
     
     
         6 . The monitoring device of  claim 1 , wherein the presented maintenance alerts are presented as maintenance recommendations. 
     
     
         7 . A non-transitory computer readable medium storing instructions executable by at least one electronic processor to perform a method of converting a flowchart to a structured electronic representation of the flowchart, the method comprising:
 identifying, in an image of the flowchart, a plurality of shapes corresponding to flowchart blocks of the flowchart in the image;   identifying arrows defining flow paths between the flowchart blocks in the image including identifying flowchart blocks connected by the arrows and identifying directionality of the defined flow paths based on arrowheads of the arrows;   identifying text labels and their locations in the image and performing optical character recognition (OCR) on the image of the flowchart to determine text content of the identified text labels;   associating the text labels with flowchart blocks or defined flow paths based on locations of the text labels, flowchart blocks, and arrows in the image; and   generating the structured electronic representation of the flowchart based on the flowchart blocks, the flow paths, and the text labels, wherein a structure of the structured electronic representation is determined at least based at least on the flow paths between the flowchart blocks of the image.   
     
     
         8 . The non-transitory computer readable medium of  claim 7 , wherein the generating of the structured electronic representation includes:
 determining shape-indicated functions of the flowchart blocks by comparing the identified shapes with standard flow chart shapes representing corresponding functions;   wherein the structure of the structured electronic representation is further determined by assigning functions to the flowchart blocks based at least on the determined shape-indicated functions.   
     
     
         9 . The non-transitory computer readable medium of  claim 7 , wherein the structure of the structured electronic representation is further determined by:
 assigning functions to the flowchart blocks based at least on the text labels associated to the flowchart blocks and/or associated to the defined flow paths.   
     
     
         10 . The non-transitory computer readable medium of  claim 7 , wherein the method further includes:
 displaying the structured electronic representation on a display device;   receiving one or more inputs from a user, via a user input device, indicative of editing a portion of the structured electronic representation; and   updating the structured electronic representation based on the received one or more inputs.   
     
     
         11 . The non-transitory computer readable medium of  claim 7 , wherein the image of the flowchart includes a plurality of images each depicting a corresponding portion of the flowchart, and the method further includes:
 repeating the identifying of the shapes, the identifying of the arrows, and generating the representation for each image of the plurality of images of the flowchart.   
     
     
         12 . The non-transitory computer readable medium of  claim 7 , wherein the generating of the structured electronic representation further includes generating a directed graph representing the structure. 
     
     
         13 . The non-transitory computer readable medium of  claim 12 , wherein the generating of the structured electronic representation further includes:
 converting the directed graph to a structured dialog flow representation.   
     
     
         14 . The non-transitory computer readable medium of  claim 13 , wherein the structured dialog flow representation comprises a JavaScript Object Notation (JSON) representation. 
     
     
         15 . The non-transitory computer readable medium of  claim 7 , further comprising providing a user interface that guides a user through the structured dialog flow representation by:
 presenting a current flowchart block of the structured electronic representation via a user interfacing device;   receiving an input from the user via the user interfacing device;   updating the current flowchart block based on the structure of the structured electronic representation and the received input from the user; and   repeating the presenting, receiving, and updating to guide the user through the flowchart.   
     
     
         16 . The non-transitory computer readable medium of  claim 15 , wherein the user interfacing device is a chatbot. 
     
     
         17 . A non-transitory computer readable medium storing instructions executable by at least one electronic processor to perform a method of converting flowcharts to structured electronic representations, the method comprising:
 identifying, in an image of a flowchart, a plurality of shapes corresponding to flowchart blocks of the flowcharts in the image;   identifying a location and directionality of a plurality of arrows defining flow paths between the flowchart blocks in the image;   generating a directed graph of the flowchart blocks; and   converting the directed graph to a structured dialog flow representation.   
     
     
         18 . The non-transitory computer readable medium of  claim 17 , wherein the structured dialog flow representation comprises a JavaScript Object Notation (JSON) representation. 
     
     
         19 . The non-transitory computer readable medium of  claim 17 , further comprising providing a user interface that guides a user through the structured dialog flow representation by:
 presenting a current flowchart block of the structured electronic representation via a chatbot;   receiving an input from the user via the chatbot;   updating the current flowchart block based on the structure of the structured electronic representation and the received input from the user; and   repeating the presenting, receiving, and updating to guide the user through the flowchart.   
     
     
         20 . The non-transitory computer readable medium of  claim 17 , wherein the generating of the structured electronic representation includes at one of:
 determining shape-indicated functions of the flowchart blocks by comparing the identified shapes with standard flow chart shapes representing corresponding functions, wherein the structure of the structured electronic representation is further determined by assigning functions to the flowchart blocks based at least on the determined shape-indicated functions; and   assigning functions to the flowchart blocks based at least on the text labels associated to the flowchart blocks and/or associated to the defined flow paths.