Method and Apparatus for Communication Between Humans and Devices

Abstract

This invention relates to methods and apparatus for improving communications between humans and devices. The invention provides a method of modulating operation of a device, comprising: providing an attentive user interface for obtaining information about an attentive state of a user; and modulating operation of a device on the basis of the obtained information, wherein the operation that is modulated is initiated by the device. Preferably, the information about the user's attentive state is eye contact of the user with the device that is sensed by the attentive user interface.

1 - 44 . (canceled) 
     
     
         45 . Apparatus for controlling outputting of information on a screen of a device, comprising:
 at least one sensor coupled to the device that outputs a sensor signal;   a processor that processes the sensor signal and produces a user state signal that is indicative of user attention toward the screen of the device;   wherein the apparatus uses the user state signal as a basis for determining whether to pause the outputting of information on the screen of the device; and   wherein the pausing of the outputting of information is initiated by the device based on said determining.   
     
     
         46 . The apparatus of  claim 45 , further comprising the apparatus using the user state signal as a basis for determining whether to resume the outputting of information on the screen of the device;
 wherein the resuming of the outputting of information is initiated by the device based on said determining.   
     
     
         47 . The apparatus of  claim 45 , further comprising the apparatus using the user state signal as a basis for determining whether to progressively control the outputting of information on the screen of the device;
 wherein the progressively controlling the outputting of information is initiated by the device based on said determining.   
     
     
         48 . The apparatus of  claim 45 , wherein the information includes audio information. 
     
     
         49 . The apparatus of  claim 45 , wherein the device is selected from the group consisting of a personal computer, a cellular telephone, a telephone, a personal digital assistant (PDA), an electronic device, a machine, a smart appliance, and an appliance. 
     
     
         50 . The apparatus of  claim 45 , wherein the outputting of information on the screen of the device includes the device soliciting user input. 
     
     
         51 . The apparatus of  claim 45 , wherein the user state signal is based on user head or face orientation. 
     
     
         52 . The apparatus of  claim 45 , wherein the user state signal is based on user eye contact. 
     
     
         53 . The apparatus of  claim 45 , wherein the user state signal is based on user body presence. 
     
     
         54 . The apparatus of  claim 45 , wherein the user state signal is based on user activity. 
     
     
         55 . The apparatus of  claim 45 , wherein the user state signal is based on user body orientation. 
     
     
         56 . The apparatus of  claim 45 , wherein the sensor comprises an infrared sensor. 
     
     
         57 . The apparatus of  claim 45 , wherein the sensor is electronically coupled to the device. 
     
     
         58 . The apparatus of  claim 45 , wherein the sensor is wirelessly coupled to the device. 
     
     
         59 . The apparatus of  claim 45 , wherein the sensor is physically coupled to the device. 
     
     
         60 . The apparatus of  claim 59 , wherein the sensor is attached to or embedded in the screen of the device. 
     
     
         61 . The apparatus of  claim 45 , wherein the screen is a video screen. 
     
     
         62 . The apparatus of  claim 45 , wherein the screen is a computer screen. 
     
     
         63 . The apparatus of  claim 45 , wherein the outputting of information comprises notifying the user when the user state signal indicates that the user attention toward the screen is at least at a selected level. 
     
     
         64 . The apparatus of  claim 63 , wherein notifying the user comprises using a less interruptive notification and progressing to a more interruptive notification. 
     
     
         65 . A method for controlling outputting of information on a screen of a device, comprising:
 using at least one sensor coupled to the device to output a sensor signal;   processing the sensor signal to produce a user state signal that is indicative of user attention toward the screen of the device;   using the user state signal as a basis for determining whether to pause the outputting of information on the screen of the device; and   wherein the pausing of the outputting of information is initiated by the device based on said determining.   
     
     
         66 . The method of  claim 65 , further comprising using the user state signal as a basis for determining whether to resume the outputting of information on the screen of the device;
 wherein the resuming of the outputting of information is initiated by the device based on said determining.   
     
     
         67 . The method of  claim 65 , further comprising using the user state signal as a basis for determining whether to progressively control the outputting of information on the screen of the device;
 wherein the progressively controlling the outputting of information is initiated by the device based on said determining.   
     
     
         68 . The method of  claim 65 , wherein the information includes audio information. 
     
     
         69 . The method of  claim 65 , wherein the device is selected from the group consisting of a personal computer, a cellular telephone, a telephone, a personal digital assistant (PDA), an electronic device, a machine, a smart appliance, and an appliance. 
     
     
         70 . The method of  claim 65 , wherein the outputting of information on the screen of the device includes the device soliciting user input. 
     
     
         71 . The method of  claim 65 , wherein the user state signal is based on user head or face orientation. 
     
     
         72 . The method of  claim 65 , wherein the user state signal is based on user eye contact. 
     
     
         73 . The method of  claim 65 , wherein the user state signal is based on user body presence. 
     
     
         74 . The method of  claim 65 , wherein the user state signal is based on user activity. 
     
     
         75 . The method of  claim 65 , wherein the user state signal is based on user body orientation. 
     
     
         76 . The method of  claim 65 , comprising using an infrared sensor. 
     
     
         77 . The method of  claim 65 , comprising electronically coupling the sensor to the device. 
     
     
         78 . The method of  claim 65 , comprising wirelessly coupling the sensor to the device. 
     
     
         79 . The method of  claim 65 , comprising physically coupling the sensor to the device. 
     
     
         80 . The method of  claim 79 , wherein the sensor is attached to or embedded in the screen of the device. 
     
     
         81 . The method of  claim 65 , wherein the screen is a video screen. 
     
     
         82 . The method of  claim 65 , wherein the screen is a computer screen. 
     
     
         83 . The method of  claim 65 , wherein the outputting of information comprises notifying the user when the user state signal indicates that the user attention toward the screen is at least at a selected level. 
     
     
         84 . The method of  claim 83 , wherein notifying the user comprises using a less interruptive notification and progressing to a more interruptive notification.