Rendering enhancement based in part on eye tracking

Abstract

An apparatus having a computing device and a user interface—such as a user interface having a display that can provide a graphical user interface (GUI). The apparatus also includes a camera, and a processor in the computing device. The camera can be connected to the computing device and/or the user interface, and the camera can be configured to capture pupil location and/or eye movement of a user. The processor can be configured to: identify a visual focal point of the user relative to the user interface based on the captured pupil location, and/or identify a type of eye movement of the user (such as a saccade) based on the captured eye movement. The processor can also be configured to control parameters of the user interface based at least partially on the identified visual focal point and/or the identified type of eye movement.

What is claimed is: 
     
         1 . A device, comprising:
 a display configured to provide a graphical user interface (GUI) to a user;   a camera configured to capture at least one of a pupil location of the user or eye movement of the user; and   a processor configured to:
 output a user interface element of the GUI to the display; 
 identify at least one of a visual focal point of the user or an eye gesture of the user based on at least one of the captured pupil location or the eye movement; and 
 control one or more parameters of the user interface element shown on the display based at least partially on at least one of the visual focal point or the eye gesture of the user. 
   
     
     
         2 . The device of  claim 1 , wherein the user interface element shown on the display relates to an auditory user interface. 
     
     
         3 . The device of  claim 1 , wherein the user interface element shown on the display relates to a tactile user interface. 
     
     
         4 . The device of  claim 1 , wherein the user interface element shown on the display relates to a visual user interface. 
     
     
         5 . The device of  claim 1 , wherein the user interface element shown on the display relates to a gustatory user interface. 
     
     
         6 . The device of  claim 1 , wherein the user interface element shown on the display relates to an equilibria user interface. 
     
     
         7 . The device of  claim 1 , wherein the processor is further configured to identify the visual focal point of the user based at least partially on a distance of the at least one pupil of the user relative to the GUI. 
     
     
         8 . The device of  claim 1 , wherein the processor is configured to control at least one of:
 skew or angle of output of the display based at least partially on the identified visual focal point of the user;   distribution of screen resolution of the display based at least partially on the identified visual focal point of the user;   distribution of screen coloring of the display based at least partially on the identified visual focal point of the user;   distribution of screen brightness of the display based at least partially on the identified visual focal point of the user;   distribution of screen shading of the display based at least partially on the identified visual focal point of the user; or   distribution of screen contrast of the display based at least partially on the identified visual focal point of the user.   
     
     
         9 . The device of  claim 1 , wherein the camera is configured to:
 capture eye movement of the user; and   wherein the processor is configured to:
 identify a saccade based on the captured eye movement of the user; and 
 further control the one or more parameters of the user interface element shown on the display based at least partially on the identified saccade. 
   
     
     
         10 . The device of  claim 9 , wherein the processor is configured to:
 approximate eye movement of the user from one focal point to another focal point according to the identified saccade; and   further control the one or more parameters of the user interface element shown on the display based at least partially on the identified approximated eye movement.   
     
     
         11 . The device of  claim 1 , further comprising a wearable structure, the wearable structure comprising or connected to at least one of the display, the camera, the processor, or a combination thereof. 
     
     
         12 . The device of  claim 11 , wherein the wearable structure is configured to be worn on a head, around a neck, or around a wrist or forearm of the user. 
     
     
         13 . The device of  claim 12 , wherein the wearable structure comprises either a cap, a wristband, a neck strap, a necklace, or a contact lens. 
     
     
         14 . A wearable computing device, comprising:
 a display configured to provide a graphical user interface (GUI) to a user, wherein the display is head-mountable such that the display stays visible to the user while the user moves or while the user's head moves;   a camera configured to capture at least one of a pupil location of the user or eye movement of the user; and   a processor configured to:
 output a user interface element of the GUI to the display; 
 identify a saccade of the user based on at least one of the captured pupil location or the eye movement; and 
 control one or more parameters of the user interface element shown on the display based at least partially on at least one of the visual focal point or the eye gesture of the user, wherein the user interface element shown on the display changes as the one or more parameters is controlled based on the at least one of the visual focal point or the eye gesture of the user, 
   wherein the wearable computing device is wearable by a human user of the wearable computing device.   
     
     
         15 . The device of  claim 14 , wherein the user interface element shown on the display relates to at least one of an auditory user interface, a tactile user interface, a visual user interface, a gustatory user interface, or an equilibria user interface. 
     
     
         16 . The device of  claim 14 , further comprising a wearable structure, the wearable structure comprising or connected to at least one of the display, the camera, the processor, or a combination thereof. 
     
     
         17 . The device of  claim 14 , wherein the wearable structure is configured to be worn on a head, around a neck, or around a wrist or forearm of the user. 
     
     
         18 . A device, comprising:
 a display configured to provide a graphical user interface (GUI) to a user;   a camera configured to capture at least one of a pupil location of the user or eye movement of the user; and   a processor configured to:
 output a user interface element of the GUI to the display; 
 identify a first predetermined eye gesture of the user based on at least one of the captured pupil location or the eye movement; 
 control a parameter of the user interface element shown on the display based at least partially on the first predetermined eye gesture; 
 identify a second predetermined eye gesture of the user based on at least one of the captured pupil location or the eye movement; 
 control the parameter of the user interface element shown on the display based at least partially on the second predetermined eye gesture; 
 repeat the output of the user interface element of the GUI to the display over time while continuing to identify additional predetermined eye gestures based on the pupil location or the eye movement and continuing to control the parameter based on the additional predetermined eye gestures. 
   
     
     
         19 . The device of  claim 18 , wherein the first predetermined eye gesture adjusts the parameter in a first direction and the second predetermined eye gesture adjusts the parameter in a second direction opposite the first direction. 
     
     
         20 . The device of  claim 19 , user interface element shown on the display is adjusted on the display based on the control of the parameter in the first direction or the second direction.