Display Management for Native User Experiences

Abstract

In some remote application execution environments, a client device (e.g., to which application output is sent and where user interaction is performed) may include native control elements for touch input such as virtual keyboards, virtual pickers and the like. When the server device detects an editable/control field of a remoted application receiving focus, the server may instruct the client to activate a native control element for user interaction. The client may determine the manner in which to modify an application display to resolve potential display conflicts. For example, a native control element may obscure or hide portions of the remoted application on the client display. Modifying the application display may include panning the display, zooming into or out of portions of the display, adapting the display for scrolling, and the like. The remote computing device may also transmit values for populating a native control element.

What is claimed is: 
     
         1 . A method comprising:
 sending, by a first computing device, to a second computing device, a display of a remoted application executing on the first computing device;   receiving, by the first computing device, input causing an application control element of the remoted application to receive focus; and   sending, by the first computing device, to the second computing device, a control value of the application control element, the transmitted control value being for populating a native graphical user input element native to the second computing device.   
     
     
         2 . The method of  claim 1 , comprising:
 sending, by the first computing device, to the second computing device, a request for the second computing device to activate, separately from the display of the remoted application, the native graphical user input element native to the second computing device.   
     
     
         3 . The method of  claim 1 , comprising:
 determining a type of the application control element of the remoted application, wherein the type of the native graphical user input element native to the second computing device corresponds to the type of the application control element of the remoted application.   
     
     
         4 . The method of  claim 1 , comprising:
 receiving information regarding a characteristic of the native graphical user input element native to the second computing device; and   modifying the application control element of the remoted application based on the characteristic of the native graphical user input element native to the second computing device.   
     
     
         5 . The method of  claim 1 , comprising:
 sending, by the first computing device, to the second computing device, a request for the second computing device to generate a display simultaneously comprising the native graphical user input element native to the second computing device and the application control element of the remoted application.   
     
     
         6 . The method of  claim 1 , comprising
 receiving additional input causing the application control element of the remoted application to lose focus; and   in response to receiving the additional input, sending a request for the second computing device to deactivate the native graphical user input element native to the second computing device.   
     
     
         7 . The method of  claim 1 , comprising:
 sending, by the first computing device, to the second computing device, at least one of a size and a position of the application control element of the remoted application.   
     
     
         8 . One or more non-transitory computer-readable media storing executable instructions that, when executed, cause a first computing device to:
 send, to a second computing device, a display of a remoted application executing on the first computing device;   receive input causing an application control element of the remoted application to receive focus; and   send, to the second computing device, a control value of the application control element, the transmitted control value being for populating a native graphical user input element native to the second computing device.   
     
     
         9 . The one or more non-transitory computer-readable media of  claim 8 , wherein the executable instructions, when executed, cause the first computing device to:
 send, to the second computing device, a request for the second computing device to activate, separately from the display of the remoted application, the native graphical user input element native to the second computing device.   
     
     
         10 . The one or more non-transitory computer-readable media of  claim 8 , wherein the executable instructions, when executed, cause the first computing device to:
 determine a type of the application control element of the remoted application, wherein the type of the native graphical user input element native to the second computing device corresponds to the type of the application control element of the remoted application.   
     
     
         11 . The one or more non-transitory computer-readable media of  claim 8 , wherein the executable instructions, when executed, cause the first computing device to:
 receive information regarding a characteristic of the native graphical user input element native to the second computing device; and   modify the application control element of the remoted application based on the characteristic of the native graphical user input element native to the second computing device.   
     
     
         12 . The one or more non-transitory computer-readable media of  claim 8 , wherein the executable instructions, when executed, cause the first computing device to:
 send, to the second computing device, a request for the second computing device to generate a display simultaneously comprising the native graphical user input element native to the second computing device and the application control element of the remoted application.   
     
     
         13 . The one or more non-transitory computer-readable media of  claim 8 , wherein the executable instructions, when executed, cause the first computing device to:
 receive additional input causing the application control element of the remoted application to lose focus; and   in response to receiving the additional input, send a request for the second computing device to deactivate the native graphical user input element native to the second computing device.   
     
     
         14 . The one or more non-transitory computer-readable media of  claim 8 , wherein the executable instructions, when executed, cause the first computing device to:
 send, to the second computing device, at least one of a size and a position of the application control element of the remoted application.   
     
     
         15 . A first computing device comprising:
 one or more processors; and   memory storing executable instructions that, when executed by the one or more processors, cause the first computing device to:
 send, to a second computing device, a display of a remoted application executing on the first computing device; 
 receive input causing an application control element of the remoted application to receive focus; and 
 send, to the second computing device, a control value of the application control element, the transmitted control value being for populating a native graphical user input element native to the second computing device. 
   
     
     
         16 . The first computing device of  claim 15 , wherein the executable instructions, when executed by the one or more processors, cause the first computing device to:
 send, to the second computing device, a request for the second computing device to activate, separately from the display of the remoted application, the native graphical user input element native to the second computing device; and   send, to the second computing device, at least one of a size and a position of the application control element of the remoted application.   
     
     
         17 . The first computing device of  claim 15 , wherein the executable instructions, when executed by the one or more processors, cause the first computing device to:
 determine a type of the application control element of the remoted application, wherein the type of the native graphical user input element native to the second computing device corresponds to the type of the application control element of the remoted application.   
     
     
         18 . The first computing device of  claim 15 , wherein the executable instructions, when executed by the one or more processors, cause the first computing device to:
 receive information regarding a characteristic of the native graphical user input element native to the second computing device; and   modify the application control element of the remoted application based on the characteristic of the native graphical user input element native to the second computing device.   
     
     
         19 . The first computing device of  claim 15 , wherein the executable instructions, when executed by the one or more processors, cause the first computing device to:
 send, to the second computing device, a request for the second computing device to generate a display simultaneously comprising the native graphical user input element native to the second computing device and the application control element of the remoted application.   
     
     
         20 . The first computing device of  claim 15 , wherein the executable instructions, when executed by the one or more processors, cause the first computing device to:
 receive additional input causing the application control element of the remoted application to lose focus; and   in response to receiving the additional input, send a request for the second computing device to deactivate the native graphical user input element native to the second computing device.