Systems and methods to operate controllable devices with gestures and/or noises

Abstract

Gesture recognition systems that are configured to provide users with simplified operation of various controllable devices such as, for example, in-home controllable devices. In one implementation, the gesture recognition system automatically configures itself in order to determine the respective physical locations and/or identities of controllable devices as well as an operating mode for controlling the controllable devices through predetermined gesturing. In some implementations, the gesture recognition systems are also configured to assign boundary areas associated with the controllable devices. Apparatus and methods associated with the gesture recognition systems are also disclosed.

1 - 20 . (canceled) 
     
     
         21 . A non-transitory computer readable storage medium having computer readable instructions stored thereon, that when executed by a processor, configure the processor to:
 operate in an auto-configuration mode to:
 emit one or more signals from a detection device; 
 detect at least one region of interest to localize at least one controllable device within a detection region of the detection device, the at least one region of interest corresponding to a spatial region comprising a detected temporal change in response to the one or more signals emitted from the detection device, the temporal change comprising at least one of an auditory or visual change of the at least one controllable devices in response to the one or more signals; and 
   operate in an operative mode, different from the auto-configuration mode, to:
 detect a predetermined gesture from a user, the predetermined gesture being associated with one or more of the at least one controllable devices, the predetermined gesture configures the one or more of the at least one controllable devices to change an operative state of the one or more of the at least one controllable devices. 
   
     
     
         22 . The non-transitory computer readable storage medium of  claim 21 , wherein the processor is further configured to execute the computer readable instructions to:
 assign a boundary area around each of the at least one region of interest and correlate the boundary area with a respective device identifier, the respective device identifier corresponding to an associated controllable device within the boundary area.   
     
     
         23 . The non-transitory computer readable storage medium of  claim 22 , wherein,
 the predetermined gesture is detected proximal to or within the boundary area of the associated controllable device, the predetermined gesture includes a gesture directed towards or otherwise indicating the associated controllable device within the boundary area to change the operative state of the associated controllable device.   
     
     
         24 . The non-transitory computer readable storage medium of  claim 22 , wherein the processor is further configured to execute the computer readable instructions to:
 determine the respective device identifier of each associated controllable device based on wireless detection within a wireless network of the respective device identifier.   
     
     
         25 . The non-transitory computer readable storage medium of  claim 21 , wherein,
 the predetermined gesture comprises at least one of an auditory noise or physical movement performed by the user, the predetermined gesture being correlated, in accordance with a training process, with a change in operative state of the one or more of the at least one controllable device in response to detection of the predetermined gesture.   
     
     
         26 . The non-transitory computer readable storage medium of  claim 25 , wherein the training process further comprises the processor configured to execute the computer readable instructions to:
 detect, within the detection region, the user performing a gesture;   detect a change in the operative state of the at least one controllable device effectuated by the user within the at least one region of interest, the change comprises at least one of an auditory or visual temporal change; and   correlate the change in the operative state with the gesture and store in memory the correlation as the predetermined gesture.   
     
     
         27 . A gesture detection system, comprising:
 a non-transitory computer readable storage medium comprising a plurality of instructions embodied thereon; and   a processor configured to execute the instructions to:
 operate in an auto-configuration mode to:
 emit one or more signals from a detection device; 
 detect at least one region of interest to localize at least one controllable device within a detection region of the detection device, the at least one region of interest corresponding to a spatial region comprising a detected temporal change in response to the one or more signals emitted from the detection device, the temporal change comprising at least one of an auditory or visual change of the at least one controllable devices in response to the one or more signals; and 
 
 operate in an operative mode, different from the auto-configuration mode, to:
 detect a predetermined gesture from a user, the predetermined gesture being associated with one or more of the at least one controllable devices, the predetermined gesture configures the one or more of the at least one controllable devices to change an operative state of the one or more of the at least one controllable devices. 
 
   
     
     
         28 . The system of  claim 27 , wherein the instructions further configure the processor to:
 assign a boundary area around each of the at least one region of interest and correlate the boundary area with a respective device identifier, the respective device identifier corresponding to an associated controllable device within the boundary area.   
     
     
         29 . The system of  claim 28 , wherein,
 the predetermined gesture is detected proximal to or within the boundary area of the associated controllable device, the predetermined gesture includes a gesture directed towards or otherwise indicating the associated controllable device within the boundary area to change the operative state of the associated controllable device.   
     
     
         30 . The system of  claim 28 , wherein the processor is further configured to execute the instructions to:
 determine the respective device identifier of each associated controllable device based on wireless detection within a wireless network of the respective device identifier.   
     
     
         31 . The system of  claim 27 , wherein,
 the predetermined gesture comprises at least one of an auditory noise or physical movement performed by the user, the predetermined gesture being correlated, in accordance with a training process, with a change in operative state of the one or more of the at least one controllable device in response to detection of the predetermined gesture.   
     
     
         32 . The system of  claim 31 , wherein the training process further comprises the processor executing the instructions to:
 detect, within the detection region, the user performing a gesture;   detect a change in the operative state of the at least one controllable device effectuated by the user within the at least one region of interest, the change comprises at least one of an auditory or visual temporal change; and   correlate the change in the operative state with the gesture and store in memory the correlation as the predetermined gesture.   
     
     
         33 . A method effectuated by a processor executing computer readable instructions, comprising the processor:
 operating in an auto-configuration mode to:
 emit one or more signals from a detection device; 
 detect at least one region of interest to localize at least one controllable device within a detection region of the detection device, the at least one region of interest corresponding to a spatial region comprising a detected temporal change in response to the one or more signals emitted from the detection device, the temporal change comprising at least one of an auditory or visual change of the at least one controllable devices in response to the one or more signals; and 
   operating in an operative mode, different from the auto-configuration mode, to:
 detect a predetermined gesture from a user, the predetermined gesture being associated with one or more of the at least one controllable devices, the predetermined gesture configures the one or more of the at least one controllable devices to change an operative state of the one or more of the at least one controllable devices. 
   
     
     
         34 . The method  claim 33 , further comprising the processor:
 assigning a boundary area around each of the at least one region of interest and correlate the boundary area with a respective device identifier, the respective device identifier corresponding to an associated controllable device within the boundary area.   
     
     
         35 . The method of  claim 34 , wherein,
 the predetermined gesture is detected proximal to or within the boundary area of the associated controllable device, the predetermined gesture includes a gesture directed towards or otherwise indicating the associated controllable device within the boundary area to change the operative state of the associated controllable device.   
     
     
         36 . The method of  claim 34 , further comprising the processor:
 determining the respective device identifier of each associated controllable device based on wireless detection within a wireless network of the respective device identifier.   
     
     
         37 . The method of  claim 33 , wherein,
 the predetermined gesture comprises at least one of an auditory noise or physical movement performed by the user, the predetermined gesture being correlated, in accordance with a training process, with a change in operative state of the one or more of the at least one controllable device in response to detection of the predetermined gesture.   
     
     
         38 . The method of  claim 37 , wherein the training process further comprises the processor:
 detecting, within the detection region, the user performing a gesture;   detecting a change in the operative state of the at least one controllable device effectuated by the user within the at least one region of interest, the change comprises at least one of an auditory or visual temporal change; and   correlating the change in the operative state with the gesture and store in memory the correlation as the predetermined gesture.