Methods and systems for touchless control with a mobile device

Abstract

Methods and systems for touchless control of a device include receiving at least one image; determining a first map, the first map including a function that generates a correspondence between data associated with the image to a feature space; determining a second map including a representation of a user in the image based on the first map; determining a third map comprising a field associated with the data in the image; determining a characteristic of the user based on one or more of the second map and the third map; and tracking the characteristic of the user to generate a historical data of the characteristic for performing the touchless control of the device.

What is claimed is: 
     
         1 . A device, comprising:
 at least one memory device that stores computer-executable instructions; and   at least one processor configured to access the memory device, wherein the processor is configured to execute the computer-executable instructions to:
 receive at least one image; 
 determine a first map, the first map comprising a function that generates a correspondence between data associated with the image to a feature space; 
 determine a second map comprising a representation of a user in the image based on the first map; 
 determine a third map comprising a field associated with the data in the image; 
 determine a characteristic of the user based on one or more of the second map and the third map; 
 track the characteristic of the user for performing control of the device to generate a historical data of the characteristic; 
 determine, based on the tracking, a mapping between the characteristic and an input feature associated with the device; 
 modify the input feature to a first location based on the mapping; and 
 modify the input feature to a second location different from the first location based on the historical data. 
   
     
     
         2 . The device of  claim 1 , wherein the computer-executable instructions to determine the characteristic comprise computer-executable instructions to determine that the characteristic has an associated duration exceeding a predetermined threshold. 
     
     
         3 . The device of  claim 1 , wherein the computer-executable instructions to track the characteristic comprise computer-executable instructions to apply a filter to measurements during the tracking. 
     
     
         4 . The device of  claim 1 , further comprising computer-executable instructions to determine a second mapping between a second characteristic of the user and the input feature by applying a mathematical transformation to the characteristic. 
     
     
         5 . The device of  claim 4 , further comprising computer-executable instructions to modify the input feature at a different speed or at a different precision based on at least one of the mapping or the second mapping. 
     
     
         6 . The device of  claim 1 , further comprising computer-executable instructions to:
 track the characteristic of the user at a frame rate;   determine that a value of a refresh rate associated with the device is different than a value of the frame rate; and   modify the input feature using a smoothing function, the smoothing function comprising parameters that are determined based on at least one of the frame rate and the refresh rate.   
     
     
         7 . A method, comprising:
 receiving at least one image;   determining a first map, the first map comprising a function that generates a correspondence between data associated with the image to a feature space;   determining a second map comprising a representation of a user in the image based on the first map;   determining a third map comprising a field associated with the data in the image;   determining a characteristic of the user based on one or more of the second map and the third map; and   tracking the characteristic of the user for performing control of the device to generate a historical data of the characteristic.   
     
     
         8 . The method of  claim 7 , further comprising:
 determining, based on the tracking, a mapping between the characteristic and an input feature associated with the device;   modifying the input feature to a first location based on the mapping; and   modifying the input feature to a second location different from the first location based on the historical data.   
     
     
         9 . The method of  claim 7 , wherein the determining the characteristic further comprises determining that the characteristic has an associated duration exceeding a predetermined threshold. 
     
     
         10 . The method of  claim 7 , wherein the tracking the characteristic further comprises applying a filter to measurements during the tracking. 
     
     
         11 . The method of  claim 7 , further comprising determining a second mapping between a second characteristic of the user and the input feature by applying a mathematical transformation to the characteristic. 
     
     
         12 . The method of  claim 11 , further comprising modifying the input feature at a different speed or at a different precision based on at least one of the mapping or the second mapping. 
     
     
         13 . The method of  claim 7 , further comprising:
 tracking the characteristic of the user at a frame rate;   determining that a value of a refresh rate associated with the device is different than a value of the frame rate; and   modifying the input feature using a smoothing function, the smoothing function comprising parameters that are determined based on at least one of the frame rate and the refresh rate.   
     
     
         14 . A non-transitory computer-readable medium storing computer-executable instructions which, when executed by a processor, cause the processor to perform operations comprising:
 receiving at least one image;   determining a first map, the first map comprising a function that generates a correspondence between data associated with the image to a feature space;   determining a second map comprising a representation of a user in the image based on the first map;   determining a third map comprising a field associated with the data in the image;   determining a characteristic of the user based on one or more of the second map and the third map; and   tracking the characteristic of the user for performing control of the device to generate a historical data of the characteristic.   
     
     
         15 . The non-transitory computer-readable medium of  claim 14 , wherein the computer-executable instructions to determine the characteristic comprise computer-executable instructions to:
 determine, based on the tracking, a mapping between the characteristic and an input feature associated with the device;   modify the input feature to a first location based on the mapping; and   modify the input feature to a second location different from the first location based on the historical data.   
     
     
         16 . The non-transitory computer-readable medium of  claim 14 , wherein the computer-executable instructions to determine the characteristic comprise computer-executable instructions to determine that the characteristic has an associated duration exceeding a predetermined threshold. 
     
     
         17 . The non-transitory computer-readable medium of  claim 14 , wherein the computer-executable instructions to track the characteristic comprise computer-executable instructions to apply a filter to measurements during the tracking. 
     
     
         18 . The non-transitory computer-readable medium of  claim 14 , further comprising computer-executable instructions to determine a second mapping between a second characteristic of the user and the input feature by applying a mathematical transformation to the characteristic. 
     
     
         19 . The non-transitory computer-readable medium of  claim 18 , further comprising computer-executable instructions to modify the input feature at a different speed or at a different precision based on at least one of the mapping or the second mapping. 
     
     
         20 . The non-transitory computer-readable medium of  claim 14 , further comprising computer-executable instructions to:
 track the characteristic of the user at a frame rate;   determine that a value of a refresh rate associated with the device is different than a value of the frame rate; and   modify the input feature using a smoothing function, the smoothing function comprising parameters that are determined based on at least one of the frame rate and the refresh rate.