System and method for control based on face or hand gesture detection

Abstract

System and method for control using face detection or hand gesture detection algorithms in a captured image Based on the existence of a detected human face or a hand gesture in an image captured by a digital camera (still or video), a control signal is generated, and provided to a device. The control may provide power or disconnect power supply to the device (or part of the device circuits). Further, the location of the detected face in the image may be used to rotate a display screen horizontally, vertically, or both, to achieve a better line of sight with a viewing person. If two or more faces are detected, the average location is calculated and used for line of sight correction. A linear feedback control loop is implemented wherein detected face deviation from the optimum is the error to be corrected by rotating the display to the required angular position. A hand gesture detection can be used as a replacement to a remote control wherein the various hand gestures controls the various function of the controlled unit, such as a television set.

1 . (canceled) 
     
     
         2 . A television set responsive to an element in an image, the television set comprising:
 a flat screen for displaying television channels;   a digital camera for capturing the image and for transmitting a digital data form of the captured image, said digital camera being oriented to capture an image of a scene substantially in front of said flat screen;   an image processor coupled to receive the image in the digital data from said digital camera and for applying an algorithm to detect the element in the captured image;   a connector for connecting to a cable that is connectable to simultaneously carry digital data signal and an DC power signal;   a transceiver coupled between said digital camera and said connector for transmitting the digital data form of the captured image over the cable; and   a single enclosure housing said flat screen, said digital camera, said image processor, said connector and said transceiver,   
       wherein information is displayed on said flat screen in response to the detection of the element in the captured image, and wherein the television set is operative to supply at least part of the DC power signal. 
     
     
         3 . The television set according to  claim 2 , wherein said digital camera being fixed in position relative to said flat screen to be movable in unison with said flat screen. 
     
     
         4 . The television set according to  claim 2 , wherein said digital camera comprises:
 an optical lens for focusing received light, a photosensitive image sensor array disposed approximately at the image focal point plane of the optical lens for capturing the image and producing an analog form of the captured image; and   an analog-to-digital (A/D) converter coupled to said image sensor for generating the digital data form of the captured image.   
     
     
         5 . The television set according to  claim 4  wherein said image sensor array is based on multiple Charge-Coupled Devices (CCD) or Complementary Metal-Oxide-Semiconductor (CMOS) based components. 
     
     
         6 . The television set according to  claim 2 , wherein the element is an image of a human face, and said image processor applies a face detection algorithm to detect an existence and a position of the human face in the captured image. 
     
     
         7 . The television set according to  claim 2 , wherein the element is an image of a human hand, and said image processor applies a hand gesture algorithm to detect an existence and a position of a hand gesture in the captured image. 
     
     
         8 . The television set according to  claim 5 , wherein said image processor further applies a face detection algorithm to detect an existence and a position of a human face in the captured image. 
     
     
         9 . The television set according to  claim 6 , wherein the detection algorithm of the hand gesture is based on the position of the human face detected in the captured image. 
     
     
         10 . The television set according to  claim 7 , wherein the hand gesture includes extending a single finger. 
     
     
         11 . The television set according to  claim 7 , wherein the hand gesture includes extending multiple fingers. 
     
     
         12 . The television set according to  claim 7 , wherein the hand gesture includes extending all fingers of one hand. 
     
     
         13 . The television set according to  claim 2 , further comprising a timer associated with a pre-set time period, and wherein said screen is blanked in response to not detecting the element in the captured image during the pre-set time period. 
     
     
         14 . The television set according to  claim 2 , wherein the information is displayed on said screen in response to a detected position of the detected element in the captured image. 
     
     
         15 . The television set according to  claim 2 , further responsive to a deviation between the position of the detected element in the captured image and a center of the captured image. 
     
     
         16 . The television set according to  claim 2 , further connected for displaying multiple television channels, and wherein a television channel is selected to be displayed on said screen in response to the detection of the element in the captured image. 
     
     
         17 . The television set according to  claim 2 , wherein said image processor comprises firmware or software and a processor to execute said firmware or software. 
     
     
         18 . The television set according to  claim 2 , wherein a power is supplied to a load in response to the detection of the element in the captured image. 
     
     
         19 . The television set according to  claim 18 , further comprising a switch connected to be actuated in response to the detection of the element in the captured image. 
     
     
         20 . The television set according to  claim 2 , wherein the cable is a Local Area Network (LAN) cable; said connector is a LAN connector; and said transceiver is a LAN transceiver. 
     
     
         21 . The television set according to  claim 20 , wherein the LAN is an Ethernet-based LAN that is according to, or based on, IEEE 802.3-2008 standard. 
     
     
         22 . The television set according to  claim 21 , wherein: the LAN cable is based on twisted-pair copper cables; said LAN transceiver is according to, or based on, 10 Base-T, 100 Base-TX, or 1000 Base-T; and said LAN connector is RJ-45 type. 
     
     
         23 . The television set according to  claim 2  wherein the digital data and the DC power signals are carried over the same wires in the cable. 
     
     
         24 . The television set according to  claim 23  further comprising a power/data splitter arrangement having first, second and third ports; said first port is coupled to said connector and said second port is coupled to said digital camera, wherein only the digital data form of the captured image signal is passed between said first and second ports, and wherein only the power signal is passed between said first and third ports. 
     
     
         25 . The television set according to  claim 23 , wherein the power and digital data signals are carried using Frequency Division/Domain Multiplexing (FDM), where the digital data signal is carried in a frequency band above and distinct from the DC power signal frequency. 
     
     
         26 . The television set according to  claim 25 , wherein said power/data splitter comprises a high pass filter between said first and second ports and a low pass filter between said first and third ports. 
     
     
         27 . The television set according to  claim 26 , wherein said power/data splitter comprising a transformer and a capacitor connected to the transformer windings. 
     
     
         28 . The television set according to  claim 24 , wherein the DC power and the digital data signals are carried using a phantom scheme. 
     
     
         29 . The television set according to  claim 28 , wherein said power/data splitter comprises at least two transformers each having a center-tap connection. 
     
     
         30 . The television set according to  claim 2 , wherein the DC power and digital data signals are carried substantially according to IEEE 802.3af-2003 or IEEE 802.3at-2009 standard. 
     
     
         31 . The television set according to  claim 2 , further comprising an image or video compressor coupled between said digital camera and said transceiver, for compressing the captured image digital data according to a compression scheme. 
     
     
         32 . The television set according to  claim 31 , wherein the compression scheme is a lossy or lossless type. 
     
     
         33 . The television set according to  claim 31 , wherein the compression scheme is according to, or based on, JPEG (Joint Photographic Experts Group) and MPEG (Moving Picture Experts Group) standard. 
     
     
         34 . The television set according to  claim 2 , wherein said flat screen is silicon-based. 
     
     
         35 . The television set according to  claim 34  wherein said flat screen is LCD (Liquid Crystal Display) or TFT (Thin-Film Transistor) based. 
     
     
         36 . The television set according to  claim 2 , further operative for displaying High Definition (HD), and wherein said television set further comprises an HDMI (High-Definition Multimedia Interface) for receiving and displaying a HD video. 
     
     
         37 . A television set responsive to an element in an image, the television set comprising:
 a flat screen for displaying television channels;   a digital camera for capturing an image and for transmitting a digital data form of the captured image, said digital camera being oriented to capture an image of a scene substantially in front of said screen;   an image processor coupled to receive the image in the digital data from said digital camera and for applying an algorithm to detect the element in the captured image;   a timer for indicating pre-set time period; and   a single enclosure housing said flat screen, said digital camera, said image processor, and said timer,   wherein said flat screen is blanked in response to not detecting the element in the captured image during the pre-set time period.   
     
     
         38 . The television set according to  claim 37  further comprising in said single enclosure:
 a connector for connecting to a cable that is connectable to simultaneously carry digital data signal and a DC power signal; and 
 a transceiver coupled between said digital camera and said connector for transmitting the digital data form of the captured image over the cable. 
 
     
     
         39 . The television set according to  claim 38  wherein the television set is operative to supply at least part of the DC power signal. 
     
     
         40 . The television set according to  claim 39 , wherein the cable is a Local Area Network (LAN) cable; said connector is a LAN connector; and said transceiver is a LAN transceiver. 
     
     
         41 . The television set according to  claim 40 , wherein the LAN is an Ethernet-based LAN that is according to, or based on, IEEE 802.3-2008 standard. 
     
     
         42 . The television set according to  claim 41 , wherein: the LAN cable is based on twisted-pair copper cables; said LAN transceiver is according to, or based on, 10 Base-T, 100 Base-TX, or 1000 Base-T; and said LAN connector is RJ-45 type. 
     
     
         43 . The television set according to  claim 39  wherein the digital data and the DC power signals are carried over the same wires in the cable. 
     
     
         44 . The television set according to  claim 37 , wherein said digital camera being fixed in position relative to said flat screen to be movable in unison with said flat screen. 
     
     
         45 . The television set according to  claim 37 , wherein said digital camera comprises:
 an optical lens for focusing received light, a photosensitive image sensor array disposed approximately at an image focal point plane of the optical lens for capturing the image and producing an analog form of the captured image; and   an analog-to-digital (A/D) converter coupled to said image sensor for generating the digital data form of the captured image.   
     
     
         46 . The television set according to  claim 37 , wherein the element is an image of a human face, and said image processor applies a face detection algorithm to detect an existence and a position of the human face in the captured image. 
     
     
         47 . The television set according to  claim 37 , wherein the element is an image of a human hand, and said image processor applies a hand gesture algorithm to detect an existence and a position of a hand gesture in the captured image. 
     
     
         48 . The television set according to  claim 47 , wherein said image processor further applies a face detection algorithm to detect an existence and a position of a human face in the captured image. 
     
     
         49 . The television set according to  claim 48 , wherein the detection algorithm of the hand gesture is based on the position of the human face detected in the captured image. 
     
     
         50 . The television set according to  claim 37 , further responsive to a deviation between the position of the detected element in the captured image and a center of the image. 
     
     
         51 . The television set according to  claim 37 , further comprising an image or video compressor coupled between said digital camera and said transceiver, for compressing the captured image digital data according to a compression scheme. 
     
     
         52 . The television set according to  claim 37 , wherein said flat screen is silicon-based. 
     
     
         53 . The television set according to  claim 52  wherein said flat screen is LCD (Liquid Crystal Display) or TFT (Thin-Film Transistor) based. 
     
     
         54 . The television set according to  claim 37 , further operative for displaying High Definition (HD), and wherein said television set further comprises an HDMI (High-Definition Multimedia Interface) for receiving and displaying a HD video. 
     
     
         55 . A television set for a human face detection based control of a device, the television set comprising in a single enclosure:
 a digital camera for capturing an image in a digital data form;   an image processor coupled to receive the image and for applying a face detection algorithm to detect a human face image in the captured image;   a controller coupled to said image processor for generating a first control signal in response to non-detection of the human face image in the captured image; and   a first timer coupled to said controller for signaling a first pre-set time period;   
       wherein said controller generates the first control signal in response to detecting the human face image followed by not detecting the human face image in the captured image for the first time period. 
     
     
         56 . The television set according to  claim 55 , further comprising a second timer for signaling a second pre-set time period, said second timer is coupled to said controller for detecting the human face in the captured image for the second pre-set period, and wherein said controller generates the first control signal in response to detecting the human face image for the second time period followed by not detecting the human face image in the captured image for the first time period. 
     
     
         57 . The television set according to  claim 55 , wherein said controller comprising firmware or software and a processor for executing said firmware or software. 
     
     
         58 . The television set according to  claim 55 , wherein said digital camera is mechanically fixed to the device. 
     
     
         59 . The television set according to  claim 55 , further comprising a switch connected to be actuated by the first control signal. 
     
     
         60 . The television set according to  claim 59 , wherein said switch is connected between a power source and the device, for powering the device in response to the first control signal. 
     
     
         61 . The television set according to  claim 60 , further operative to actuate said switch and to supply power to the device is response to the detection of the human face image in the captured image. 
     
     
         62 . The television set according to  claim 60 , further operative to actuate said switch and for supplying power to the device is response to not detecting the human face in the captured image. 
     
     
         63 . The television set according to  claim 59 , wherein said switch is housed within the single enclosure. 
     
     
         64 . The television set according to  claim 55 , wherein said digital camera is positioned such that the image captured is substantially in front of a display screen of said television set. 
     
     
         65 . The television set according to  claim 55 , wherein said television set is operative to blank the display of said television set in response to not detecting the human face image in the captured image. 
     
     
         66 . A method for controlling a television set having a screen, the method comprising the steps of:
 capturing an image of a scene substantially in front of the screen;   applying a face detection algorithm to detect a human face image in the captured image;   non-detecting the human face image in the captured image after detecting the human face image in the captured image; and   affecting the screen in response to the non-detecting the human face image in the captured image.   
     
     
         67 . The method according to  claim 66  further preceded by the step of disposing the television set having a single enclosure. 
     
     
         68 . The method according to  claim 66  further preceded by the step of disposing a digital camera for capturing the image in a digital data form. 
     
     
         69 . The method according to  claim 68 , further comprising the step of mechanically fixing the digital camera to the television set. 
     
     
         70 . The method according to  claim 66  further comprising the step of measuring a time period of the non-detecting of the human face image in the captured image. 
     
     
         71 . The method according to  claim 70  wherein the affecting of the screen is in response to the non-detecting the human face image in the captured image for a first time period. 
     
     
         72 . The method according to  claim 66  further comprising the step of measuring a time period of the detecting of the human face image in the captured image. 
     
     
         73 . The method according to  claim 72  wherein the affecting of the screen is in response to the detecting the human face image in the captured image for a first time period. 
     
     
         74 . The method according to  claim 66  further operative for the non-detecting of the human face image in the captured image for a first time period after detecting the human face image in the captured image for a second time period. 
     
     
         75 . The method according to  claim 66  wherein the affecting of the screen comprising switching of a signal. 
     
     
         76 . The method according to  claim 75 , wherein the signal is a power signal. 
     
     
         77 . The method according to  claim 66 , wherein the affecting of the screen comprising blanking the display on the screen.