Predictive determination

Abstract

Systems, methods and computer readable media are disclosed for a gesture recognizer system architecture. A recognizer engine is provided, which receives user motion data and provides that data to a plurality of filters. A filter corresponds to a gesture, that may then be tuned by an application receiving information from the gesture recognizer so that the specific parameters of the gesture—such as an arm acceleration for a throwing gesture—may be set on a per-application level, or multiple times within a single application. Each filter may output to an application using it a confidence level that the corresponding gesture occurred, as well as further details about the user motion data.

1 . A method for predicting a gesture made by a user to a first application, comprising:
 receiving data captured by a camera, the data corresponding to the first application;   applying a filter to the data, the filter representing the gesture to the first application and comprising base information about the gesture;   determining, from the applied filter, an output corresponding to the gesture being performed, before receiving data corresponding to the gesture being completed; and   sending the first application the output.   
     
     
         2 . The method of  claim 1 , wherein determining, from the applied filter, an output corresponding to the gesture being performed, before receiving data corresponding to the gesture being completed includes:
 determining that future received data will correspond to the gesture being performed based on a correlation between the data and a prior data that corresponds to the gesture being completed.   
     
     
         3 . The method of  claim 1 , wherein determining, from the applied filter, an output corresponding to the gesture being performed, before receiving data corresponding to the gesture being completed includes:
 determining that future received data will correspond to the gesture being performed based on a physiology of the user.   
     
     
         4 . The method of  claim 1 , wherein the output comprises a confidence level that the data is indicative of the gesture being performed. 
     
     
         5 . The method of  claim 1 , wherein the output comprises an indication that the filter is being predicted. 
     
     
         6 . The method of  claim 1 , further comprising:
 receiving second data captured by a camera, the second data corresponding to the first application;   applying the filter to the second data;   determining from the applied filter that the gesture has been performed;   determining a second output based on the applied filter; and   sending the first application the second output.   
     
     
         7 . The method of  claim 6 , wherein the output comprises an indication that the filter is being predicted and the second output comprises an indication that the filter has been completed. 
     
     
         8 . The method of  claim 1 , further comprising:
 receiving second data captured by a camera, the second data corresponding to the first application;   applying the filter to the second data;   determining from the applied filter that the gesture was not performed;   determining a second output based on the applied filter, the second output indicating that the gesture was not performed; and   sending the first application the second output.   
     
     
         9 . The method of  claim 1 , wherein a filter comprises at least one parameter about the gesture, and determining the output based on the applied filter includes:
 determining the output based on the parameter.   
     
     
         10 . The method of  claim 9 , wherein a parameter is one selected from the group consisting of a body part, a volume of space, a velocity, a direction of movement, an angle, and a place where a movement occurs. 
     
     
         11 . The method of  claim 1 , wherein a filter comprises a first parameter about the gesture and a second parameter about the gesture, the first parameter corresponding to an earlier part of the gesture than the second parameter includes
 determining the output corresponds to a high confidence level when the first parameter corresponds to a high confidence level and the second parameter does not correspond to a high confidence level.   
     
     
         12 . The method of  claim 1 , wherein the output corresponds to an output that would be determined when the gesture was completed. 
     
     
         13 . The method of  claim 1 , wherein the filter is linked to a previous filter, and determining, from the applied filter, an output corresponding to the gesture being performed, includes:
 determining the output based on a prior output of the previous filter.   
     
     
         14 . The method of  claim 1 , further comprising:
 applying a second filter to the data, the second filter representing a second gesture to the first application and comprising base information about the second gesture;   determining, from the applied second filter, a second output corresponding to the second gesture being performed and a context, the second output being indicative of a greater confidence level than the output, before receiving data corresponding to the gesture being completed; and   sending the first application the second output.   
     
     
         15 . A system for predicting a gesture made by a user to a first application, comprising:
 a processor;   a gesture library comprising at least one filter representing a gesture, the filter comprising base information about the gesture; and   a gesture recognizer engine that receives data captured by a camera corresponding to the application, determines an output from the base information about the gesture, and sends the application the output before receiving data corresponding to the gesture being completed.   
     
     
         16 . The system of  claim 15 , further comprising:
 a voice receiver that receives voice data; and   the gesture recognizer engine further determines the output based on the voice data.   
     
     
         17 . The system of  claim 15 , wherein a filter comprises at least one parameter about the gesture, and the gesture recognizer engine further:
 determines the output based on the parameter.   
     
     
         18 . The system of  claim 15 , wherein the gesture recognizer engine further:
 sends the application at least one selected from the group consisting of a velocity of movement, a release point, a distance, and a body part that made the gesture.   
     
     
         19 . The system of  claim 15 , wherein the gesture recognizer engine further:
 sends the application a plurality of outputs, each output corresponding to a filter of a plurality of filters.   
     
     
         20 . A computer readable storage medium, comprising computer readable instructions that when executed on a processor, cause the processor to perform the operations of:
 providing a filter representing a gesture to the plurality of applications, the filter comprising base information about the gesture and at least one parameter about the gesture;   receiving from a first application of the plurality of applications a value for at least one parameter;   receiving data captured by a depth camera, the data corresponding to a first application of the plurality of applications;   applying the filter to the data and determining from the base information about the gesture and the value of the parameter a confidence level that the data is indicative of the gesture being performed, before receiving data corresponding to the gesture being completed; and   sending the first application the confidence level.