System and method for using gaze control to control electronic switches and machinery

Abstract

A system that detects a gaze interaction from a user or animal based on information received from a camera. For example, the user looks directly at the camera or is looking at an angle toward the camera. In response to detecting the gaze interaction, the system identifies an associated action for controlling one or more of an electrical element and a mechanical element. For example, the action may be to control lighting system. The action is then initiated to control the one or more of the electrical element and the mechanical element.

What is claimed is: 
     
         1 . A device comprising:
 a microprocessor;   a computer readable medium, coupled with the microprocessor and comprising microprocessor readable and executable instructions that program the microprocessor to:
 detect a gaze interaction from a user or animal based on information received from a camera; 
 in response to detecting the gaze interaction, identify an action for controlling one or more of an electrical element and a mechanical element; and 
 initiate the action to control the one or more of the electrical element and the mechanical element. 
   
     
     
         2 . The device of  claim 1 , wherein the camera is in the device, wherein the action is to power on the device, and wherein the microprocessor readable and executable instructions further program the microprocessor to ask if the user wants to speak a voice command that controls the device. 
     
     
         3 . The device of  claim 1 , wherein the gaze interaction is based on gaze information received from a plurality of different cameras and wherein the gaze interaction is a sequence of gaze interactions with the plurality of different cameras that is used for at least one of: a user authentication process and a multi-function control process. 
     
     
         4 . The device of  claim 3 , wherein the sequence of gaze interactions with the plurality of different cameras is used for the user authentication process. 
     
     
         5 . The device of  claim 3 , wherein the sequence of gaze interactions with the plurality of different cameras is used for the multi-function control process. 
     
     
         6 . The device of  claim 1 , wherein the gaze interaction comprises a plurality of gaze quadrants that are used to initiate a plurality of different actions to control the one or more of the electrical element and the mechanical element. 
     
     
         7 . The device of  claim 6 , wherein the plurality of gaze quadrants are used as part of a gaze sequence for authenticating a user. 
     
     
         8 . The device of  claim 1 , wherein the gaze interaction is coupled with one or more gestures in order to initiate the action to control the one or more of the electrical element and the mechanical element. 
     
     
         9 . The device of  claim 1 , wherein detecting the gaze interaction is used to control an alarm system and wherein the action is to initiate different alarm actions based on whether the detected gaze interaction is a direct gaze interaction or an indirect gaze interaction. 
     
     
         10 . The device of  claim 1 , wherein the gaze interaction is coupled with one or more touch events to initiate the action to control the one or more of the electrical element and the mechanical element. 
     
     
         11 . The device of  claim 1 , wherein the gaze interaction is coupled with one or more voice commands to initiate the action to control the one or more of the electrical element and the mechanical element. 
     
     
         12 . A method comprising:
 detecting, by a microprocessor, a gaze interaction from a user or animal based on information received from a camera;   in response to detecting the gaze interaction, identifying, by the microprocessor, an action for controlling one or more of an electrical element and a mechanical element; and   initiating, by the microprocessor, the action to control the one or more of the electrical element and the mechanical element.   
     
     
         13 . The method of  claim 12 , wherein the camera is in the device, wherein the action is to power on the device, and further comprising, asking, by the microprocessor, if the user wants to speak a voice command that controls the device. 
     
     
         14 . The method of  claim 12 , wherein the gaze interaction is based on gaze information received from a plurality of different cameras and wherein the gaze interaction is a sequence of gaze interactions with the plurality of different cameras that is used for at least one of: a user authentication process and a multi-function control process. 
     
     
         15 . The method of  claim 14 , wherein the sequence of gaze interactions with the plurality of different cameras is used for the user authentication process. 
     
     
         16 . The method of  claim 12 , wherein the gaze interaction comprises a plurality of gaze quadrants that are used to initiate a plurality of different actions to control the one or more of the electrical element and the mechanical element. 
     
     
         17 . The method of  claim 16 , wherein the plurality of gaze quadrants are used as part of a gaze sequence for authenticating a user. 
     
     
         18 . The method of  claim 12 , wherein the gaze interaction is coupled with one or more gestures in order to initiate the action to control the one or more of the electrical element and the mechanical element. 
     
     
         19 . The method of  claim 12 , wherein detecting the gaze interaction is used to control an alarm system and wherein the action is to initiate different alarm actions based on whether the detected gaze interaction is a direct gaze interaction or an indirect gaze interaction. 
     
     
         20 . The method of  claim 12 , wherein the gaze interaction is coupled with one or more touch events to initiate the action to control the one or more of the electrical element and the mechanical element.