Operation of head mounted device from eye data

Abstract

A method of operating a head mounted device includes capturing eye data with one or more sensors of the head mounted device. The one or more sensors are configured to sense an eyebox region. The eye data may include images. Operations of the head mounted device are adjusted in response to the eye data.

what is claimed is: 
     
         1 . A method of operating a head mounted device, the method comprising:
 capturing, with an imaging module of the head mounted device, one or more images of an eye in an eyebox region of the head mounted device;   performing image processing on the one or more images of the eye to determine a heart rate of a user of the head mounted device; and   adjusting a transparency of a lens of the head mounted device based at least in part on the heart rate of the user.   
     
     
         2 . The method of  claim 1  further comprising:
 initiating an ambient light measurement with a photodetector of the head mounted device, wherein adjusting the transparency of the lens of the head mounted device is also based on the ambient light measurement. 
 
     
     
         3 . The method of  claim 2 , wherein adjusting the transparency of the lens of the head mounted device in response to the heart rate and the ambient light measurement includes adjusting the transparency of the lens to a predetermined lens transparency value associated with aggregate eye data corresponding to the ambient light measurement. 
     
     
         4 . The method of  claim 2 , wherein the photodetector includes a camera. 
     
     
         5 . The method of  claim 1 , wherein the imaging module includes a MEMS mirror-based laser system. 
     
     
         6 . The method of  claim 1 , wherein the imaging module includes a camera. 
     
     
         7 . The method of  claim 1 , wherein the performing image processing includes determining a pupil size of the eye over a time period. 
     
     
         8 . A method of operating a head mounted device, the method comprising:
 capturing eye data with one or more sensors of the head mounted device, wherein the one or more sensors are configured to sense an eyebox region; and   adjusting a volume of an audio output of the head mounted device, wherein adjusting the volume of the audio output of the head mounted device is in response to the eye data and an ambient noise measurement.   
     
     
         9 . The method of  claim 8 , wherein the eye data includes at least one of a pupil size of an eye, speed of pupil dilation of the eye, a gaze direction of the eye, or eye-movement data. 
     
     
         10 . The method of  claim 8 , wherein the eye data includes one or more images of an eye. 
     
     
         11 . The method of  claim 10  further comprising:
 performing image processing on the one or more images of the eye to determine a heart rate of a user of the head mounted device. 
 
     
     
         12 . The method of  claim 10  further comprising:
 performing image processing on the one or more images of the eye to determine at least one of movement of eyebrows, movement of eyelids, or facial muscle micro gestures, and wherein adjusting the volume of the audio output of the head mounted device is based at least in part on the movement of eyebrows, the movement of eyelids, or the facial muscle micro gestures. 
 
     
     
         13 . The method of  claim 8 , wherein the eye data includes a number of saccades in a time period. 
     
     
         14 . The method of  claim 8 , wherein the one or more sensors of the head mounted device includes one or more photodiodes. 
     
     
         15 . The method of  claim 8 , wherein the ambient noise measurement is generated by one or more microphones of the head mounted device. 
     
     
         16 . The method of  claim 8 , wherein the volume of the audio output is adjusted higher in response to a higher audio output level of the ambient noise measurement taken in a high-noise environment. 
     
     
         17 . The method of  claim 8 , wherein the volume of the audio output is adjusted lower in response to a lower audio output level of the ambient noise measurement taken in a low-noise environment. 
     
     
         18 . A head mounted device comprising:
 a camera configured to capture one or more images of an eye in an eyebox region of the head mounted device;   processing logic configured receive the one or more images from the camera, wherein the processing logic is also configured to perform image processing on the one or more images of the eye to determine at least one of movement of eyebrows, movement of eyelids, or facial muscle micro gestures; and   a lens, wherein the processing logic is also configured to adjust a transparency of the lens based at least in part on the movement of eyebrows, the movement of eyelids, or the facial muscle micro gestures.   
     
     
         19 . The head mounted device of  claim 18  further comprising:
 a photodetector configured to generate an ambient light measurement, wherein the processing logic is further configured to adjust the transparency of the lens of the head mounted device based on the ambient light measurement and the heart rate of the user. 
 
     
     
         20 . The head mounted device of  claim 19 , wherein the photodetector includes an image sensor.