Gesture recognition using a mobile device

Abstract

A mobile device configured to perform gesture recognition for a vehicle information and/or entertainment system comprises a depth camera; an orientation sensor; and a processor configured to detect one or more gestures from images captured by the depth camera according to a gesture detection algorithm; in which the processor is configured to vary the gesture detection algorithm in dependence upon an orientation of the mobile device detected by the orientation sensor.

1 - 18 . (canceled) 
     
     
         19 . A device comprising processor circuitry configured to:
 acquire a user gesture based on depth information captured with a source of depth information, the user gesture being recognizable as a same gesture from a number of different in-vehicle spatial locations of the source of depth information;   detect a gravitational change in the device by sensor circuitry of the device;   control user gesture detection based on the gravitational change and a set of gestures; and   convey control information based on the user gesture to an interface of circuitry of the vehicle.   
     
     
         20 . The device as claimed in  claim 19 , wherein the user gesture is recognisable by the device from the number of different in-vehicle spatial locations of the source of depth information by varying detection parameters used by the processor circuitry. 
     
     
         21 . The device as claimed in  claim 20 , wherein the detection parameters are controlled to prevent unintentional detection of a change in orientation of the source of the depth information. 
     
     
         22 . The device as claimed in  claim 20 , wherein the detection parameters are controlled to prevent unintentional detection of a change in location of the source of the depth information. 
     
     
         23 . The device as claimed in  claim 19 , wherein gravitational change relates to a change in acceleration. 
     
     
         24 . The device as claimed in  claim 23 , wherein the change in acceleration is a vehicle directional change. 
     
     
         25 . The device as claimed in  claim 19 , wherein the device is a mobile device. 
     
     
         26 . The device as claimed in  claim 19 , the device is a head mountable apparatus comprising a display. 
     
     
         27 . The device as claimed in  claim 19 , wherein the source of depth information of the device is selected from a list comprising a time of flight sensor; a stereoscopic camera; and a structured light camera emitting a structured light pattern. 
     
     
         28 . The device as claimed in  claim 19 , wherein the user gesture is recognized by the device based on a library stored in non-transitory storage of feature points indicative of different particular gestures among the set of gestures. 
     
     
         29 . The device as claimed in  claim 19 , wherein the sensor circuitry provides device orientation information. 
     
     
         30 . The device as claimed in  claim 29 , wherein the orientation information is smoothed over a time period to reduce a number of determined orientation changes within the time period, and the determined orientation changes are derived from a plurality of gravitational changes. 
     
     
         31 . The device as claimed in  claim 30 , wherein the time period is less that a time to execute a sharp turn in the vehicle. 
     
     
         32 . The device as claimed in  claim 19 , wherein detection parameters used by the processor circuitry are varied less frequently in time than a depth information capture rate of depth information from a source of depth information. 
     
     
         33 . The device as claimed in  claim 19 , wherein the gravitational change is determined by a change from vertical of a gravity vector. 
     
     
         34 . The device as claimed in  claim 33 , wherein the sensor circuitry comprises one or more of a gravity sensor, an acceleration sensor, and a gyroscopic sensor. 
     
     
         35 . A method comprising:
 acquiring a user gesture based on depth information captured from a source of depth information of the device, the user gesture being recognizable as a same gesture from a number of different in-vehicle spatial locations of the source of depth information;   detecting, using sensor circuitry, a gravitational change;   controlling user gesture detection based on the gravitational change and a set of gestures; and   conveying control information based on the user gesture to an interface of circuitry of the vehicle.   
     
     
         36 . An in-vehicle information system comprising processor circuitry configured to:
 receive information representative of a user gesture based on depth information captured from a source of depth information, the user gesture being recognizable as a same gesture from a number of different in-vehicle spatial locations of the source of depth information;   receive information representing a gravitational change from sensor circuitry;   control user gesture detection based on the gravitational change and a set of gestures; and   convey control information based on the user gesture to an interface of circuitry of the vehicle.