Low-latency visual response to input via pre-generation of alternative graphical representations of application elements and input handling on a graphical processing unit

Abstract

A method for providing a visual response to input with reduced latency in a computing device includes computing alternative sets of intermediate data for a first graphical user interface element, each alternative set of intermediate data comprising data useful to produce a visual representation of the graphical user interface element. The plurality of alternative sets of intermediate data and a set of intermediate data for a second graphical user interface element are stored in memory. The method creates an index identifying a first one of the plurality of alternative sets of intermediate data for the first graphical user interface element to use in forming a final pixel image. The index, the first set of alternative intermediate data for the graphical user interface element, and the intermediate data for the second graphical user interface element are used to create a first final pixel image for display to a user, the first final pixel image including the first and second graphical user interface elements. In response to user input, the index is modified to include an identification of a second one of the plurality of alternative sets of intermediate data for the first graphical user interface element, and the modified index is used to create a final pixel image for display to a user.

1 . A method of operating a graphical processing unit (GPU) in conjunction with a central processing unit (CPU) to provide a visual response to input with reduced latency in a computing device, comprising:
 receiving, in a graphical processing unit, date representing user input;   hit testing the data representing user input in the graphical processing unit to identify a graphical user interface element to be updated as a result of the user input;   identifying, in the graphical processing unit, a first set of intermediate instructions among a plurality of alternative sets of intermediate instructions for the graphical user interface element;   using the identified alternative set of intermediate instructions to update the graphical user interface element.   
     
     
         2 . The method of  claim 1 , wherein the step of using the identified alternative set of intermediate instructions to update the graphical user interface element is performed by the graphical processing unit. 
     
     
         3 . The method of  claim 1 , wherein the step of using the identified alternative set of intermediate instructions to update the graphical user interface element is performed by the central processing unit. 
     
     
         4 . A method for operating a graphical processing unit (GPU) in conjunction with a central processing unit (CPU) to provide a visual response to input with reduced latency in a computing device, comprising:
 receiving, in a graphical processing unit, data representing user input;   hit testing the data representing user input in the graphical processing unit to identify a graphical user interface element to be updated as a result of the user input;   identifying a first set of intermediate instructions among a plurality of alternative sets of intermediate instructions for the graphical user interface element;   using the identified alternative set of intermediate instructions to update the graphical user interface element.   
     
     
         5 . A method for operating processing units to provide a visual response to a running animation in a computing device, comprising:
 processing, in at least one processing unit, a property animation;   identifying, in the at least one processing unit, a first set of intermediate instructions among a plurality of alternative sets of intermediate instructions for the property animation;   using the identified alternative set of intermediate instructions to update the intermediate instructions for the property animation;   executing the updated interim data for the property animation in the graphical processing unit.   
     
     
         6 . The method of  claim 5 , wherein at least one of the at least processing units is a GPU. 
     
     
         7 . The method of  claim 5 , wherein the at least one processing units comprise a plurality of cores of the same CPU.