Augmented reality guidance for medical devices

Abstract

The disclosed techniques involve identifying a current state of a user interface of a medical device based at least in part on a portion of the medical device captured by an imaging device. The techniques also involve generating guidance information pertaining to the current state of the user interface. The techniques further involve presenting a guidance overlay including the guidance information pertaining to the current state of the user interface.

What is claimed is: 
     
         1 . A processor-implemented method comprising:
 identifying a current state of a user interface of a medical device based at least in part on a portion of the medical device captured by an imaging device;   generating guidance information pertaining to the current state of the user interface; and   presenting a guidance overlay including the guidance information pertaining to the current state of the user interface.   
     
     
         2 . The processor-implemented method of  claim 1 , further comprising presenting a graphical representation of the portion of the medical device captured by the imaging device, wherein the guidance overlay visually overlies the graphical representation of the portion of the medical device. 
     
     
         3 . The processor-implemented method of  claim 2 , the portion of the medical device including the user interface, wherein presenting the guidance overlay comprises displaying the guidance overlay adjacent to the graphical representation of the user interface. 
     
     
         4 . The processor-implemented method of  claim 1 , further comprising obtaining settings information corresponding to a current configuration of the medical device, wherein the guidance information is influenced by the current configuration. 
     
     
         5 . The processor-implemented method of  claim 1 , further comprising identifying a user objective. 
     
     
         6 . The processor-implemented method of  claim 5 , wherein the user objective comprises configuring a feature of the medical device, wherein generating the guidance information comprises determining a user action to facilitate configuring the feature based on the current state of the user interface, and wherein presenting the guidance overlay comprises providing a graphical indication of the user action with respect to the user interface of the medical device. 
     
     
         7 . The processor-implemented method of  claim 6 , wherein the current state of the user interface comprises a current graphical user interface (GUI) display presented by the medical device, wherein determining the user action comprises determining the user action for advancing from the current GUI display to a different GUI display for configuring the feature of the medical device. 
     
     
         8 . The processor-implemented method of  claim 7 , wherein identifying the current state of the user interface comprises recognizing the current GUI display from among a plurality of potential GUI displays associated with the medical device based at least in part on the portion of the medical device captured by the imaging device. 
     
     
         9 . The processor-implemented method of  claim 7 , wherein:
 the current GUI display includes a menu; and   the guidance overlay is positioned adjacent to the menu.   
     
     
         10 . The processor-implemented method of  claim 5 , wherein the user objective comprises understanding the current state of the user interface. 
     
     
         11 . The processor-implemented method of  claim 10 , wherein:
 generating the guidance information comprises:
 obtaining user guide information associated with the medical device, and 
 generating explanatory information pertaining to the current state of the user interface based at least in part on the user guide information; and 
   presenting the guidance overlay comprises providing the explanatory information overlying the portion of the medical device.   
     
     
         12 . The processor-implemented method of  claim 11 , wherein the current state of the user interface comprises a current graphical user interface (GUI) display presented by the medical device, wherein identifying the current state of the user interface comprises recognizing the current GUI display from among a plurality of potential GUI displays associated with the medical device based at least in part on the portion of the medical device captured by the imaging device, and wherein generating the explanatory information comprises generating the explanatory information pertaining to the current GUI display based at least in part on the user guide information associated with the current GUI display. 
     
     
         13 . The processor-implemented method of  claim 10 , wherein:
 the current state of the user interface comprises a graphical user interface (GUI) display depicting historical data associated with a patient;   generating the guidance information comprises:
 obtaining the historical data associated with the patient, and 
 determining one or more metrics characterizing the historical data; and 
   the guidance overlay includes the one or more metrics.   
     
     
         14 . The processor-implemented method of  claim 13 , wherein identifying the current state of the user interface comprises recognizing the user interface as displaying the GUI display depicting historical data associated with the patient from among a plurality of potential GUI displays based at least in part on the portion of the medical device captured by the imaging device. 
     
     
         15 . The processor-implemented method of  claim 10 , wherein:
 the current state of the user interface comprises a graphical user interface (GUI) display depicting historical data associated with a patient;   generating the guidance information comprises:
 obtaining the historical data associated with the patient, and 
 determining a recommended action based at least in part on the historical data; and 
   the guidance overlay includes a graphical indication of the recommended action.   
     
     
         16 . The processor-implemented method of  claim 15 , wherein the graphical indication comprises a GUI element selectable to cause configuration of the medical device to implement the recommended action, wherein the method further comprises causing configuration of the medical device to autonomously perform the recommended action in response to selection of the GUI element. 
     
     
         17 . The processor-implemented method of  claim 15 , wherein the graphical indication comprises a GUI element selectable to cause automatic generation of a user notification pertaining to the recommended action. 
     
     
         18 . The processor-implemented method of  claim 5 , wherein:
 the user objective comprises adjusting a setting of the medical device;   generating the guidance information comprises:
 obtaining user guide information associated with the medical device, and 
 determining a user action for transitioning from the current state of the user interface to a different state associated with the setting of the medical device; and 
   the guidance information indicates the user action.   
     
     
         19 . A system comprising:
 one or more processors; and   one or more processor-readable media storing instructions which, when executed by the one or more processors, cause performance of:
 identifying a current state of a user interface of a medical device based at least in part on a portion of the medical device captured by an imaging device; 
 generating guidance information pertaining to the current state of the user interface; and 
 presenting a guidance overlay including the guidance information pertaining to the current state of the user interface. 
   
     
     
         20 . One or more non-transitory processor-readable media storing instructions which, when executed by one or more processors, cause performance of:
 identifying a current state of a user interface of a medical device based at least in part on a portion of the medical device captured by an imaging device;   generating guidance information pertaining to the current state of the user interface; and   presenting a guidance overlay including the guidance information pertaining to the current state of the user interface.