Gesture identification

Abstract

Various methods and systems are provided to allow a user to perform finger gesture motions, such as making typing, swiping, tapping, or other types of finger motions to provide device input, such as typing, clicking, or selecting data into a webpage, application, operating system, or toolbar, that was normally performed by the user having to use a keyboard, mouse, stylus, microphone, touchscreen, or another input device.

What is claimed is: 
     
         1 . A system comprising:
 a non-transitory memory; and   one or more hardware processors coupled to the non-transitory memory and configured to execute instructions from the non-transitory memory to cause the system to perform operations comprising:
 capturing, by a sensor associated with the system, a gesture motion; 
 accessing a database of a plurality of previously stored gesture mappings, wherein each of the plurality of previously stored gesture mappings correspond to a gesture motion performable by a user, and wherein the plurality of previously stored gesture mappings corresponds to a plurality of actions executable by the system; 
 determining that the captured gesture motion is within a threshold of differences for at least one of the plurality of previously stored gesture mappings, wherein the threshold of differences corresponds to an error tolerance; and 
 executing, in response to the determining that the captured gesture motion corresponds to the at least one of the plurality of previously stored gesture mappings, at least one of the plurality of actions corresponding to the at least one of the plurality of previously stored gesture mappings. 
   
     
     
         2 . The system of  claim 1 , wherein the operations further comprise displaying an indication of the at least one of the plurality of previously stored gesture mappings associated with the captured gesture motion for confirmation, wherein the at least one of the plurality of actions is executed further in response to receiving, from the user, a selection of one of the at least one of the plurality of previously stored gesture mappings. 
     
     
         3 . The system of  claim 1 , wherein the operations further comprise detecting a process with which the gesture motion is used, and wherein a level of the error tolerance is determined based on the detected process. 
     
     
         4 . The system of  claim 3 , wherein a process requiring higher security has a lower level of the error tolerance than a process requiring lower security. 
     
     
         5 . The system of  claim 1 , wherein the operations further comprise detecting an environment in which gesture motion is being performed, and wherein a level of the error tolerance is determined based on the detected environment. 
     
     
         6 . The system of  claim 5 , wherein the level of the error tolerance is increased in response to a detection of increased movement in the environment. 
     
     
         7 . The system of  claim 1 , wherein the database includes at least one of a cache or a random access memory (RAM), and wherein the operations further comprise:
 tracking a frequency of use of the captured gesture motion, the gesture mappings corresponding to gesture motions performable by the user, wherein when the frequency is determined to be above a frequency threshold, the gesture mappings are caused to be stored in the cache or RAM for quick access.   
     
     
         8 . The system of  claim 1 , wherein the captured gesture motion includes a finger gesture motion captured by a sensor on the system. 
     
     
         9 . A method comprising:
 capturing, by a sensor, a gesture motion;   accessing a database of a plurality of previously stored gesture mappings, wherein each of the plurality of previously stored gesture mappings correspond to a gesture motion performable by a user, and wherein the plurality of previously stored gesture mappings corresponds to a plurality of actions executable by the system;   determining that the captured gesture motion is within a threshold of differences for at least one of the plurality of previously stored gesture mappings, wherein the threshold of differences corresponds to an error tolerance; and   executing, in response to the determining that the captured gesture motion corresponds to the at least one of the plurality of previously stored gesture mappings, at least one of the plurality of actions corresponding to the at least one of the plurality of previously stored gesture mappings.   
     
     
         10 . The method of  claim 9 , further comprising displaying an indication of the at least one of the plurality of previously stored gesture mappings associated with the captured gesture motion for confirmation, wherein the at least one of the plurality of actions is executed further in response to receiving, from the user, a selection of one of the at least one of the plurality of previously stored gesture mappings. 
     
     
         11 . The method of  claim 9 , wherein the operations further comprise detecting a process with which the gesture motion is used, and wherein a level of the error tolerance is determined based on the detected process. 
     
     
         12 . The method of  claim 9 , wherein the operations further comprise detecting an environment in which gesture motion is being performed, and wherein a level of the error tolerance is determined based on the detected environment. 
     
     
         13 . The method of  claim 12 , wherein the level of the error tolerance is increased in response to a detection of increased movement in the environment. 
     
     
         14 . The method of  claim 9 , wherein the database includes at least one of a cache or a random access memory (RAM), the method further comprising:
 tracking a frequency of use of the captured gesture motion, the gesture mappings corresponding to gesture motions performable by the user, wherein when the frequency is determined to be above a frequency threshold, the gesture mappings are caused to be stored in the cache or RAM for quick access.   
     
     
         15 . The method of  claim 9 , wherein the captured gesture motion includes a finger gesture motion captured by the sensor. 
     
     
         16 . A non-transitory machine-readable medium having stored thereon machine-readable instructions executable to cause a machine to perform operations comprising:
 capturing, by a sensor associated with the system, a gesture motion;   accessing a database of a plurality of previously stored gesture mappings, wherein each of the plurality of previously stored gesture mappings correspond to a gesture motion performable by a user, and wherein the plurality of previously stored gesture mappings corresponds to a plurality of actions executable by the system;   determining that the captured gesture motion is within a threshold of differences for at least one of the plurality of previously stored gesture mappings, wherein the threshold of differences corresponds to an error tolerance; and   executing, in response to the determining that the captured gesture motion corresponds to the at least one of the plurality of previously stored gesture mappings, at least one of the plurality of actions corresponding to the at least one of the plurality of previously stored gesture mappings.   
     
     
         17 . The non-transitory machine-readable medium of  claim 16 , wherein the operations further comprise displaying an indication of the at least one of the plurality of previously stored gesture mappings associated with the captured gesture motion for confirmation, wherein the at least one of the plurality of actions is executed further in response to receiving, from the user, a selection of one of the at least one of the plurality of previously stored gesture mappings. 
     
     
         18 . The non-transitory machine-readable medium of  claim 16 , wherein the operations further comprise detecting a process with which the gesture motion is used, wherein a level of the error tolerance is determined based on the detected process, and wherein a process requiring higher security has a lower level of the error tolerance than a process requiring lower security. 
     
     
         19 . The non-transitory machine-readable medium of  claim 16 , wherein the database includes at least one of a cache or a random access memory (RAM), and wherein the operations further comprise:
 tracking a frequency of use of the captured gesture motion, the gesture mappings corresponding to gesture motions performable by the user, wherein when the frequency is determined to be above a frequency threshold, the gesture mappings are caused to be stored in the cache or RAM for quick access.   
     
     
         20 . The non-transitory machine-readable medium of  claim 16 , wherein the captured gesture motion includes a finger gesture motion captured by the sensor associated with the system.