Operating room and surgical site awareness

Abstract

The present disclosure is directed to an augmented reality head mounted device worn by a user. The device includes an image capture device configured to capture an image of a surgical environment and a transparent lens configured to display an augmented image based on the image of the surgical environment. An eye tracking module coupled to the transparent lens configured to determine a direction of a gaze of an eye of the user, wherein the direction of the gaze of the eye determined by the eye tracking module is used to manipulate the augmented image.

What is claimed is: 
     
         1 . An augmented reality head mounted device worn by a user comprising:
 an image capture device configured to capture an image of a surgical environment;   a lens configured to display an augmented image based on the image of the surgical environment; and   an eye tracking module coupled to the lens display and configured to determine a direction of a gaze of an eye of the user,   wherein the direction of the gaze of the eye determined by the eye tracking module is used to manipulate the augmented image.   
     
     
         2 . The augmented reality head mounted device of  claim 1 , further comprising a microphone. 
     
     
         3 . The augmented reality head mounted device of  claim 1 , wherein the image capture device captures a three dimensional image. 
     
     
         4 . The augmented reality head mounted device of  claim 1 , wherein the augmented image includes biometric data of a patient. 
     
     
         5 . The augmented reality head mounted device of  claim 1 , wherein the augmented image includes a highlighted portion, wherein the highlighted portion is determined by the gaze of the eye of the user. 
     
     
         6 . The augmented reality head mounted device of  claim 1 , wherein the lens is transparent. 
     
     
         7 . The augmented reality head mounted device of  claim 1 , wherein the image capture device is mounted to a first side of the lens and a monitor is mounted to a second side of the lens opposite the first side. 
     
     
         8 . A surgical system comprising:
 a surgical instrument;   a first augmented reality head mounted display configured to be worn by a first user;   a second augmented reality head mounted display configured to be worn by a second user; and   a controller configured to provide a first augmented image to the first augmented reality head mounted display and a second augmented image to the second augmented reality head mounted display.   
     
     
         9 . The surgical system of  claim 8 , wherein the surgical instrument is a robotic surgical instrument. 
     
     
         10 . The surgical system of  claim 9 , further comprising a surgical console including a robotic controller and a gesture detector. 
     
     
         11 . The surgical system of  claim 10 , wherein the gesture detector is configured to detect hand movement of the first user and provide a signal indicative of the hand movement to the controller. 
     
     
         12 . The surgical system of  claim 11 , wherein the first augmented image includes a virtual representation provided by the controller and the controller manipulates the virtual representation based on the signal. 
     
     
         13 . The surgical system of  claim 12 , wherein the virtual representation is an image of a patient. 
     
     
         14 . The surgical system of  claim 12 , wherein the virtual representation is a virtual control panel. 
     
     
         15 . The surgical system of  claim 8 , wherein the first augmented reality head mounted device includes:
 a first image capture device configured to capture an image of a surgical environment and provide the first image to the controller, wherein the controller uses the first image to generate the first augmented image;   a first lens configured to receive and display the first augmented image; and   a first eye tracking module coupled to the first lens and configured to determine a direction of a gaze of an eye of the first user,   wherein the direction of the gaze of the eye of the first user determined by the first eye tracking module is used to manipulate the first augmented image.   
     
     
         16 . The surgical system of  claim 15 , wherein the second augmented reality head mounted device includes:
 a second image capture device configured to capture an image of a surgical environment and provide the second image to the controller, wherein the controller uses the second image to generate the second augmented image;   a second lens configured to receive and display the second augmented image; and   a second eye tracking module coupled to the second lens and configured to determine a direction of a gaze of an eye of the second user,   wherein the direction of the gaze of the eye of the second user determined by the second eye tracking module is used to manipulate the second augmented image.   
     
     
         17 . The surgical system of  claim 16 , wherein the controller receives the direction of the gaze of the eye of the first user from the first tracking module, highlights a first portion of the first augmented image based on the direction of the gaze of the eye of the first user, and highlights a second portion of the second augmented image, wherein the second portion corresponds to the first portion.