Controlling a function via gaze detection

Abstract

Aspects of the present disclosure relate to systems and methods for controlling a function of a computing system using gaze detection. In examples, one or more images of a user are received and gaze information may be determined from the received one or more images. Non-gaze information may be received when the gaze information is determined to satisfy a condition. Accordingly, a function may be enabled based on the received non-gaze information. In examples, the gaze information may be determined by extracting a plurality of features from the received one or more images, providing the plurality of features to a neural network, and determining, utilizing the neural network, a location at a display device at which a gaze of the user is directed.

What is claimed is: 
     
         1 . A method for controlling a function via gaze detection, the method comprising:
 receiving one or more images of a user;   determining gaze information from the received one or more images;   receiving non-gaze information when the gaze information is determined to satisfy a condition; and   enabling a function based on the non-gaze information.   
     
     
         2 . The method of  claim 1 , wherein the non-gaze information includes a stored image of the user; and
 enabling the function includes authenticating the user for access to an access controlled system.   
     
     
         3 . The method of  claim 1 , further comprising:
 receiving one or more second images including the user and a second user;   determining second gaze information for the second user from the received one or more second images;   identifying the second user associated with the second gaze information; and   enabling the function includes causing a display of content displayed at a display device to be modified based on the identity of the second user.   
     
     
         4 . The method of  claim 3 , further comprising:
 determining content displayed at the display device; and   obscuring less than all of the content displayed at the display device based on the identity of the second user.   
     
     
         5 . The method of  claim 1 , wherein the function includes one or more of controlling a brightness of a display device, resetting an inactivity timer, and obtaining a second image. 
     
     
         6 . The method of  claim 1 , wherein determining gaze information from the received one or more images includes:
 extracting a plurality of features from the received one or more images;   providing the plurality of features to a neural network; and   determining, utilizing the neural network, a location at a display device at which a gaze of the user is directed.   
     
     
         7 . The method of  claim 6 , wherein the gaze information is determined to satisfy the condition when the location at the display device at which the gaze of the user is directed coincides with a region including a graphical element. 
     
     
         8 . The method of  claim 1 , wherein determining gaze information from the received one or more images includes:
 extracting a plurality of features from the received one or more images;   providing the plurality of features to a neural network; and   determining, utilizing the neural network, a location at a location other than a display device at which a gaze of the user is directed.   
     
     
         9 . The method of  claim 8 , further comprising determining, utilizing the neural network, a future predicted location at the display device associated with a future predicted gaze of the user. 
     
     
         10 . A system for controlling a function via gaze detection, the system comprising:
 a processor;   an image sensor; and   memory including instructions, which when executed by the processor, cause the processor to:   receive one or more images of a user from the image sensor;   determine gaze information from the received one or more images;   determine if the gaze information satisfies a condition;   receive non-gaze information associated with at least one of a function or application of a computing system when the gaze information satisfies the condition; and   enable the at least one function or application based on non-gaze information.   
     
     
         11 . The system of  claim 10 , wherein at least one processor is a neural processing unit. 
     
     
         12 . The system of  claim 10 , wherein the instructions, when executed by the processor, cause the processor to:
 receive second one or more images including the user and a second user;   determine second gaze information for the second user from the received second one or more images;   identify the second user associated with the second gaze information; and   cause a display of content displayed at a display device to be modified based on the identity of the second user.   
     
     
         13 . The system of  claim 12 , wherein the instructions, when executed by the processor, cause the processor to:
 obscure less than all of the content displayed at the display device based on the identity of the second user.   
     
     
         14 . The system of  claim 10 , wherein the at least one function or application at least one of controls a brightness of a display device, resets an inactivity timer, obtains a second image, changes a font size, changes resolution, and changes a display refresh rate. 
     
     
         15 . The system of  claim 10 , wherein the instructions, when executed by the processor, cause the processor to:
 extract a plurality of features from the received one or more images;   provide the plurality of features to a neural network; and   determine, utilizing the neural network, a location at a display device at which a gaze of the user is directed.   
     
     
         16 . The system of  claim 15 , wherein the gaze information satisfies the condition when the location at the display device at which the gaze of the user is directed coincides with a region including a graphical element. 
     
     
         17 . The system of  claim 15 , wherein the instructions, when executed by the processor, cause the processor to:
 extract a plurality of features from the received one or more images;   provide the plurality of features to a neural network; and   determine, utilizing the neural network, a location at a location other than a display device at which a gaze of the user is directed.   
     
     
         18 . The system of  claim 17 , wherein the instructions, when executed by the processor, cause the processor to determine a predicted location at the display device associated with a predicted gaze of the user. 
     
     
         19 . A computer storage medium including instructions, which when executed by a processor, cause the processor to:
 receive one or more images of a user from an image sensor;   determine gaze information from the received one or more images;   determine if the gaze information satisfies a condition;   receive device dependent information associated with at least one of a function or application of a computing system when the gaze information is determined to satisfy the condition; and   enable at least one function or application based on the device dependent information.   
     
     
         20 . The computer storage medium of  claim 19 , wherein the instructions, which when executed by a processor, cause the processor to:
 extract a plurality of features from the received one or more images;   provide the plurality of features to a neural network; and   determine, utilizing the neural network, a location at a display device at which a gaze of the user is directed,   wherein, the gaze information satisfies the condition when the location at a display device at which the gaze of the user is directed coincides with a region including a graphical element associated with the at least one function or application.