System and method for control based on face or hand gesture detection

Abstract

System and method for control using face detection or hand gesture detection algorithms in a captured image. Based on the existence of a detected human face or a hand gesture in an image captured by a digital camera, a control signal is generated and provided to a device. The control may provide power or disconnect power supply to the device (or part of the device circuits). The location of the detected face in the image may be used to rotate a display screen to achieve a better line of sight with a viewing person. The difference between the location of the detected face and an optimum is the error to be corrected by rotating the display to the required angular position. A hand gesture detection can be used as a replacement to a remote control for the controlled unit, such as a television set.

1 . An apparatus for signaling based on detecting an element in an image, said apparatus comprising:
 a digital camera for capturing the image in digital data form;   an image processor coupled to receive the image in digital data form from said digital camera, for applying an element detection algorithm to detect the element in the captured image; and   software and a processor to execute said software coupled to control said image processor and said digital camera; and   a port for outputting a first signal coupled to said processor;   wherein said processor produces the first signal in response to detecting the element in the image for at least a first time period, followed by detecting the absence of the element in the image for at least a second time period.   
     
     
         2 . The apparatus according to  claim 1 , wherein said digital camera comprises:
 an optical lens for focusing received light, said lens being mechanically oriented to guide the image;   a photosensitive image sensor array disposed approximately at an image focal point plane of the optical lens for capturing the image and producing an analog signal representing the image; and   an analog-to-digital (A/D) converter coupled to said image sensor array for converting the analog signal to a digital data representation of the image.   
     
     
         3 . The apparatus according to  claim 2 , wherein said image sensor array is based on Charge-Coupled Devices (CCD) or Complementary Metal-Oxide-Semiconductor (CMOS). 
     
     
         4 . The apparatus according to  claim 1 , wherein the element is part of a human body. 
     
     
         5 . The apparatus according to  claim 4 , wherein the element is a human face, and wherein said image processor applies a face detection algorithm to detect the image of the human face in the captured image. 
     
     
         6 . The apparatus according to  claim 4 , wherein the element is a human hand, and wherein said image processor applies a human hand detection algorithm to detect the image of the human hand in the captured image. 
     
     
         7 . The apparatus according to  claim 6 , wherein the element is a hand gesture, and wherein said image processor applies a hand gesture detection algorithm to detect the image of the hand gesture in the captured image. 
     
     
         8 . The apparatus according to  claim 7 , wherein the hand gesture includes extending a single finger. 
     
     
         9 . The apparatus according to  claim 7 , wherein the hand gesture includes extending multiple fingers. 
     
     
         10 . The apparatus according to  claim 7 , wherein the hand gesture includes extending all fingers of one hand. 
     
     
         11 . The apparatus according to  claim 1 , wherein said image processor is further operative to detect the position of the element in the captured image. 
     
     
         12 . The apparatus according to  claim 11 , wherein said first signal is produced in response to the element position in the captured image. 
     
     
         13 . The apparatus according to  claim 1 , said apparatus being further operative to detect two elements in the captured image. 
     
     
         14 . The apparatus according to  claim 13 , wherein said first signal is produced in response to detecting the two elements in the captured image. 
     
     
         15 . The apparatus according to  claim 13 , wherein the two elements are of the same type. 
     
     
         16 . The apparatus according to  claim 13 , wherein the two elements are of the same shape. 
     
     
         17 . The apparatus according to  claim 13 , wherein the two elements are distinct from each other. 
     
     
         18 . The apparatus according to  claim 13 , wherein one of the elements is detected based on detection of the other element. 
     
     
         19 . The apparatus according to  claim 18 , wherein one of the elements is detected based on the position of the other element. 
     
     
         20 . The apparatus according to  claim 13 , wherein one of the elements is a human body part. 
     
     
         21 . The apparatus according to  claim 20 , wherein the two elements are human body parts. 
     
     
         22 . The apparatus according to  claim 21 , wherein one of the elements is a human face. 
     
     
         23 . The apparatus according to  claim 21 , wherein one of the elements is a human hand. 
     
     
         24 . The apparatus according to  claim 23 , wherein one of the elements is a hand gesture. 
     
     
         25 . The apparatus according to  claim 21 , wherein one of the elements is a human hand and the other element is a human face. 
     
     
         26 . The apparatus according to  claim 1 , wherein said digital camera, said image processor, said port, and said processor are housed within a single enclosure. 
     
     
         27 . The apparatus according to  claim 1 , further comprising, a single enclosure, and a display in said single enclosure, said display having a screen for visually presenting information, said display being coupled to be controlled by said processor. 
     
     
         28 . The apparatus according to  claim 27 , wherein said digital camera, said image processor, said port, and said processor are housed within said single enclosure. 
     
     
         29 . The apparatus according to  claim 27 , wherein said display is coupled to said port so that said screen is blanked in response to detecting the element in the image for at least the first time period, followed by detecting the absence of the element in the image for at least the second time period. 
     
     
         30 . The apparatus according to  claim 27 , wherein said display is part of a television set. 
     
     
         31 . The apparatus according to  claim 30 , wherein, said single enclosure is a television set enclosure and said digital camera, said image processor, said port and said processor are housed within the television set enclosure. 
     
     
         32 . The apparatus according to  claim 27 , wherein said display is part of a personal computer. 
     
     
         33 . The apparatus according to  claim 32 , wherein said single enclosure is an enclosure for the personal computer, and said digital camera, said image processor, said port, said display, and said processor are housed within the personal computer enclosure. 
     
     
         34 . The apparatus according to  claim 27 , wherein information is displayed on said screen in response to the first signal. 
     
     
         35 . The apparatus according to  claim 27 , wherein said digital camera is mechanically attached to said display. 
     
     
         36 . The apparatus according to  claim 35 , wherein said digital camera is mounted to capture an image in front of the display screen. 
     
     
         37 . The apparatus according to  claim 1 , wherein: said port is a communication port for coupling to a network medium; and said apparatus further comprises a transceiver coupled to said communication port for communicating the first signal over the network medium. 
     
     
         38 . The apparatus according to  claim 37 , wherein said communication port is an antenna for over-the-air radio-frequency communication, and wherein said transceiver is a wireless transceiver. 
     
     
         39 . The apparatus according to  claim 38 , wherein the over-the-air radio-frequency communication uses a license-free frequency band. 
     
     
         40 . The apparatus according to  claim 39 , wherein the license-free frequency band is an ISM band. 
     
     
         41 . The apparatus according to  claim 40 , wherein the ISM band is 5 GHz or 2.4 GHz. 
     
     
         42 . The apparatus according to  claim 39 , wherein the over-the-air radio-frequency communication takes place in a Wireless Personal Area Network (WPAN), wherein said antenna is a WPAN antenna, and wherein said wireless transceiver is a WPAN transceiver. 
     
     
         43 . The apparatus according to  claim 42 , wherein the WPAN is according to, or based on, Bluetooth, IEEE 802.15, Ultra-Wide-Band (UWB), or ZigBee. 
     
     
         44 . The apparatus according to  claim 39 , wherein the over-the-air radio-frequency communication takes place over a Wireless Local Area Network (WLAN), wherein said antenna is a WLAN antenna, and wherein said wireless transceiver is a WLAN transceiver. 
     
     
         45 . The apparatus according to  claim 44 , wherein the WLAN is according to, or based on, IEEE 802.11a, IEEE802.11b, or IEEE802.11g. 
     
     
         46 . The apparatus according to  claim 39 , wherein the over-the-air radio-frequency communication is a Wireless Wide Area Network (WWAN) communication, wherein said antenna is a WWAN antenna, and wherein said wireless transceiver is a WWAN transceiver. 
     
     
         47 . The apparatus according to  claim 39 , wherein the over-the-air radio-frequency communication is a cellular communication, wherein said antenna is a cellular antenna, and wherein said wireless transceiver is a cellular transceiver. 
     
     
         48 . The apparatus according to  claim 47 , wherein the cellular communication is according to, or based on, GSM (Global System for Mobile Communications), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), EDGE (Enhanced Data Rates for GSM Evolution), 3GSM, DECT (Digital Enhanced Cordless Telecommunications), Digital AMPS, or iDEN (Integrated Digital Enhanced Network). 
     
     
         49 . The apparatus according to  claim 39 , wherein the over-the-air radio-frequency communication uses a 60 GHz license-free frequency band, and wherein said over-the-air radio-frequency communication is used for in-room communication. 
     
     
         50 . The apparatus according to  claim 49 , wherein said over-the-air radio-frequency communication is based on beam forming and supports a data rate above 7 Gb/s. 
     
     
         51 . The apparatus according to  claim 50 , wherein said over-the-air radio-frequency communication is according to, or based on, WirelessHD™. 
     
     
         52 . The apparatus according to  claim 37 , wherein communication over the network medium is based on visible or non-visible light communication. 
     
     
         53 . The apparatus according to  claim 37 , wherein the network medium is a cable, said communication port is a connector for connecting to the cable, and said transceiver is a wired transceiver. 
     
     
         54 . The apparatus according to  claim 53 , wherein the cable is operative for use in a Local Area Network (LAN), wherein said connector is a LAN connector, and wherein said wired transceiver is a LAN transceiver. 
     
     
         55 . The apparatus according to  claim 54 , wherein the LAN is Ethernet based, and is according to, or based on, IEEE 802.3-2008 standard. 
     
     
         56 . The apparatus according to  claim 55 , wherein the cable is based on twisted-pair copper cables, and wherein said LAN transceiver is according to, or based on, 10Base-T, 100Base-TX, or 1000Base-T, and wherein said LAN connector is RJ-45 type. 
     
     
         57 . The apparatus according to  claim 53 , wherein the cable is connectable to simultaneously carry a DC or AC power signal. 
     
     
         58 . The apparatus according to  claim 57 , further operative to output at least part of the power signal to a device external to the apparatus. 
     
     
         59 . The apparatus according to  claim 57 , wherein said apparatus is further operative to at least in part be powered from the power signal. 
     
     
         60 . The apparatus according to  claim 57 , wherein the power signal is carried over dedicated wires in the cable, and wherein the wires are distinct from wires in the cable carrying the first signal. 
     
     
         61 . The apparatus according to  claim 57 , wherein the power signal and the first signal are carried over the same wires in the cable, and wherein said apparatus further comprises a power/data splitter arrangement having first, second and third ports, wherein only the first signal is passed between said first and second ports, and only the power signal is passed between said first and third ports, and wherein said first port is coupled to said connector. 
     
     
         62 . The apparatus according to  claim 61 , wherein the power and digital data signals are carried using Frequency Division/Domain Multiplexing (FDM), and wherein the first signal is carried in a frequency band higher than, and distinct from, the power signal frequency or frequency band. 
     
     
         63 . The apparatus according to  claim 62 , wherein said power/data splitter arrangement comprises a high pass filter between said first and second ports and a low pass filter between said first and third ports. 
     
     
         64 . The apparatus according to  claim 63 , wherein said power/data splitter arrangement comprises a transformer having windings and a capacitor connected to the transformer windings. 
     
     
         65 . The apparatus according to  claim 62 , wherein said power and first signals are carried using a phantom scheme. 
     
     
         66 . The apparatus according to  claim 65 , wherein said power/data splitter comprises at least two transformers each having a center-tap connection. 
     
     
         67 . The apparatus according to  claim 57 , wherein said power and first signals are carried substantially according to IEEE 802.3af-2003 or IEEE 802.3 at-2009 standards. 
     
     
         68 . The apparatus according to  claim 1 , wherein power is supplied to or disconnected from a device connected to and external to said apparatus in response to detecting the element in the image for at least the first time period, followed by detecting the absence of the element in the image for at least the second time period. 
     
     
         69 . The apparatus according to  claim 68 , further comprising a switch coupled to said processor connected to be actuated in response to the first signal. 
     
     
         70 . The apparatus according to  claim 68 , wherein the device is an electromechanical device for moving an article in response to the first signal. 
     
     
         71 . The apparatus according to  claim 70 , wherein the device is an electric motor. 
     
     
         72 . The apparatus according to  claim 71 , wherein the electric motor is a stepper motor. 
     
     
         73 . The apparatus according to  claim 68 , wherein the device is mechanically coupled to said digital camera. 
     
     
         74 . An apparatus for signaling based on detecting an element in an image, said apparatus comprising:
 a digital camera for capturing the image in digital data form;   an image processor coupled to receive the image in digital data form from said digital camera, for applying an element detection algorithm to detect the element in the captured image;   software and a processor to execute said software coupled to control said image processor and said digital camera; and   a port for outputting a first signal coupled to said processor;   wherein said processor produces the first signal in response to the absence of the element in the image for at least a first time period.