Response to user input based on declarative mappings

Abstract

Systems and methods are provided that enable direct response to user input, e.g., in accordance with storyboards. For instance, applications can predefine storyboards which describe output in terms of received input. The predefined storyboards can be used externally and independently from the applications to process user input on behalf of the applications.

1 - 20 . (canceled) 
     
     
         21 . A method executed by at least one processor of a computing device, comprising:
 receiving, by a direct manipulation process executing on the computing device, a declarative mapping from an application process that is also executing on the computing device, wherein the declarative mapping correlates a predefined change to be made in a display output of the computing device to a predefined user input;   receiving, by the direct manipulation process, the predefined user input; and   in response to receiving the predefined user input, making, by the direct manipulation process, the predefined change to the display output on behalf of the application process without intervention of the application process.   
     
     
         22 . The method of  claim 21 , wherein:
 the predefined user input is a touch manipulation;   receiving the predefined user input includes receiving the touch manipulation via a touch interface.   
     
     
         23 . The method of  claim 21 , further comprising:
 determining whether the received touch manipulation is associated with the declarative mapping.   
     
     
         24 . The method of  claim 21 , further comprising:
 receiving, by the direct manipulation process, additional user input;   determining whether the additional user input is the predefined user input; and   forwarding the additional user input to the application process in response a determination that the user input is not the predefined user input.   
     
     
         25 . The method of  claim 21 , further comprising:
 receiving at least one other declarative mapping, each of the at least one other declarative mappings correlating an associated predefined change to be made in the display output of the computing device to an associated predefined user input, the declarative mapping and the at least one other declarative mappings comprising a set of declarative mappings;   receiving, by the direct manipulation process, additional user input; and   in response to receiving the additional user input:
 identifying an input manipulation represented by the additional user input; and 
 selecting, from the set of declarative mappings, at least one declarative mapping that is associated with the identified input manipulation. 
   
     
     
         26 . The method of  claim 25 , further comprising:
 determining a set of values associated with the identified input manipulation based on the additional user input.   
     
     
         27 . The method of  claim 25 , further comprising:
 generating an output transform based on the set of output parameters, including:   generating a manipulation on at least one of a region or an object for the application process.   
     
     
         28 . The method of  claim 25 , further comprising:
 transmitting the display output to a graphics subsystem for presentation on a display device.   
     
     
         29 . A computing device, comprising
 a memory and a processor, the memory and the processor respectively configured to store and execute instructions for the computing device, the instructions being organized into at least:
 an input component configured to receive:
 a declarative mapping from an application executing on the computing device; and 
 user input corresponding to a touch manipulation received via a touch interface; and 
 
 an output transform component configured to create an output transform on behalf of the application executing on the computing device, without intervention of the application executing on the computing device, based upon the declarative mapping, wherein the output transform represents a response to the user input. 
   
     
     
         30 . The computing device of  claim 29 , wherein the instructions are further organized into:
 an input evaluation component configured to determine whether the received user input corresponds to a touch manipulation for which a declarative mapping has been received.   
     
     
         31 . The computing device of  claim 29 , wherein the instructions are further organized into:
 a manipulation analysis component configured to identify a set of values associated with the user input.   
     
     
         32 . The computing device of  claim 31 , wherein the instructions are further organized into:
 a parameter determination component configured to derive an output parameter for the output transform, and, based on the at least one declarative mapping, obtain a set of output parameters corresponding to the set of values associated with the user input.   
     
     
         33 . The computing device of  claim 29 , wherein the declarative mapping defines a plurality of functions that map a set of input parameters of the user input to a set of output parameters specifying an output for a response to the user input. 
     
     
         34 . The computing device of  claim 29 , wherein the output transform component is further configured to generate the output transform independently of the application. 
     
     
         35 . A computer storage device having instructions stored therein, the stored instructions being executable by a processor of a computing device for implementing a direct manipulation subsystem on the computing device, and the stored instructions being organized into at least:
 a direct manipulation component configured to execute on the computing device and to receive:
 a set of declarative mappings from an application executing on the computing device; and 
 touch input for the application executing on the computing device, wherein: 
   the direct manipulation component is also configured to derive output in response to the touch input on behalf of the application executing on the computing device based on the set of declarative mappings.   
     
     
         36 . The computing device of  claim 35 , wherein the set of declarative mappings define types of touch manipulations of a set of touch manipulations. 
     
     
         37 . The computing device of  claim 35 , wherein the set of declarative mappings is associated with a region of a display on which the application executing on the computing device renders application content. 
     
     
         38 . The computing device of  claim 35 , wherein the direct manipulation component is further configured to apply the output to a display of the computing device without instruction from the application executing on the computing device. 
     
     
         39 . The computing device of  claim 35 , wherein the direct manipulation component is further configured to provide the output to an operating system executing on the computing device as an instruction to a graphics processing unit of the computing device to apply an output transform. 
     
     
         40 . The computing device of  claim 35 , wherein the set of declarative mappings includes respective declarative mappings for a set of characteristics of the touch input.