Mouse cursor and content migration between 3d space and physical flat displays

Abstract

Systems are configured to control transitions and displays of interface objects that are selectively moved across boundary transitions of physical display screens within augmented-reality scenes. In some instances, when a virtual object instance of an interface object is moved into the bounded area of a physical display screen within an augmented-reality scene a corresponding real-world object instance of the interface object is generated and rendered within the bounded display area of the display screen. In other instances, when user input is received for moving a real-world object instance of an interface object outside of the bounded display area of a display screen within an augmented-reality scene, a corresponding virtual object instance of the interface object is generated and rendered outside of the display screen within the augmented-reality scene.

What is claimed is: 
     
         1 . A computing system comprising:
 one or more processors; and   one or more computer-readable hardware storage media having stored thereon computer-executable instructions, the computer-executable instructions being executable by the one or more processors to cause the computer system to:
 generate and render a real-world object instance of a controllable interface object of an application running on the computing system at a location within a bounded display area of a physical real-world display connected to the computing system; 
 detect user input for rendering the controllable interface object outside of the bounded display area of the physical real-world display; and 
 generate and render a virtual object instance of the controllable interface object at a location that is at least partially outside of the bounded display area of the physical real-world display within an augmented-reality scene that also includes visibility of the physical real-world, the interactive virtual object instance being generated and rendered in response to detecting user input for rendering the controllable interface object outside of the bounded display area of the physical real-world display. 
   
     
     
         2 . The computing system of  claim 1 , wherein the user input for rendering the controllable interface object outside of the bounded display area of the physical real-world display includes user input for selecting and moving the real-world object instance of the controllable interface object from at least a first position within the bounded display area to a second position that is at least partially outside of the bounded display area of the physical real-world display, prior to rendering the virtual object instance of the controllable interface object at the second position. 
     
     
         3 . The computing system of  claim 2 , wherein the computer-executable instructions are further executable for configuring the computing system to render the real-world object instance of the controllable interface object at one or more different positions than the first and second positions, entirely within and/or adjacent to an edge of the bounded display area of a physical real-world display, and in response to detecting user input for selecting and moving the real-world object instance of the controllable interface object from the first position to a second position within the bounded display area of the physical real-world display. 
     
     
         4 . The computing system of  claim 3 , wherein the computer-executable instructions are further executable for configuring the computing system to render a first portion of the controllable interface object with the virtual instance of the controllable interface object outside of the bounded display area while rendering a remaining portion of the controllable interface object with the real-world object instance at the second position within the bounded display area and in such a manner that it appears that the first portion and the second portion of the controllable interface object are connected together as an integrated version of the controllable interface object. 
     
     
         5 . The computing system of  claim 1 , wherein the computer-executable instructions are further executable for configuring the computing system to terminate a display of the real-world object instance of the controllable interface object in response to generating the virtual rendering the virtual instance of the controllable interface object. 
     
     
         6 . The computing system of  claim 1 , wherein the computer-executable instructions are further executable for configuring the computing system to animate movement of the controllable interface object as it is moved from the location within the bounded display area to the location that is at least partially outside of the bounded display area within the augmented-reality scene. 
     
     
         7 . The computing system of  claim 1 , wherein the computer-executable instructions are further executable for configuring the computing system to modify how the virtual object instance of the controllable interface object is rendered, including (i) using a first presentation mode with a first set of display properties for rendering an unobstructed view of the virtual object instance in the augmented-reality scene either in front of and/or overlapping with the physical real-world display and (ii) using a second presentation mode with a different set of display properties for rendering an obstructed view of the virtual object instance, when the virtual object instance is displayed behind the physical real-world display in the augmented-reality scene, with a portion of the virtual object instance of the controllable interface object being omitted from view in the augmented-reality scene. 
     
     
         8 . The computing system of  claim 7 , wherein the computer-executable instructions are further executable for configuring the computing system to render the interactive virtual object instance in the first presentation mode, subsequent displaying the virtual object instance of the controllable interface object in the second presentation mode, and in response to detecting attention directed to the virtual object instance of the controllable interface object subsequent to displaying the virtual object instance of the controllable interface object in the second presentation mode. 
     
     
         9 . The computing system of  claim 1 , wherein the computer-executable instructions are further executable for configuring the computing system to process a selection of an element rendered within the virtual object instance of the controllable interface object by a control prompt that is rendered by the computing system within the bounded display area of the physical real-world display. 
     
     
         10 . The computing system of  claim 1 , wherein the controllable interface object comprises a control prompt and wherein the computer-executable instructions are further executable for configuring the computing system to select a particular object displayed within the augmented-reality scene with the control prompt and in response to at least detecting user input for moving the virtual object instance of the controllable interface object to the particular object within the augmented-reality scene. 
     
     
         11 . The computing system of  claim 1 , wherein the computer-executable instructions are further executable for configuring the computing system to render the real-world object instance of the controllable interface object with a first presentation style and to render the virtual object instance of the controllable interface object with a second presentation style that is different than the first presentation style, the first presentation style having a size, coloring or shape for rendering the real-world object instance of the controllable interface object that is different than a respective size, coloring or shape of the second presentation style for rendering the virtual object instance of the controllable interface object. 
     
     
         12 . The computing system of  claim 1 , wherein the controllable interface object is a visual prompt configured for controllably selecting and interacting with content displayed on the physical real-world display. 
     
     
         13 . The computing system of  claim 1 , wherein rendering a representation of the controllable interface object entirely outside the bounded display area of the physical real-world display only occurs after first determining that the user input is sufficient for moving the controllable interface object at least a threshold percentage outside of the bounded area of the physical display screen the augmented-reality scene. 
     
     
         14 . A computer-implemented method for managing presentations of controllable interface objects, the method comprising:
 generating and rendering a real-world object instance of a controllable interface object of an application running on the computing system at a location within a bounded display area of a physical real-world display connected to the computing system;   detecting user input for rendering the controllable interface object outside of the bounded display area of the physical real-world display; and   generating and rendering a virtual object instance of the controllable interface object at a location that is at least partially outside of the bounded display area of the physical real-world display within an augmented-reality scene that also includes visibility of the physical real-world, the interactive virtual object instance being generated and rendered in response to detecting user input for rendering the controllable interface object outside of the bounded display area of the physical real-world display.   
     
     
         15 . The method of  claim 14 , wherein the user input for rendering the controllable interface object outside of the bounded display area of the physical real-world display includes user input for selecting and moving the real-world object instance of the controllable interface object from at least a first position within the bounded display area to a second position that is at least partially outside of the bounded display area of the physical real-world display, prior to rendering the virtual object instance of the controllable interface object at the second position. 
     
     
         16 . The method of  claim 14 , wherein the further includes:
 rendering a first portion of the controllable interface object with the virtual instance of the controllable interface object outside of the bounded display area while rendering a remaining portion of the controllable interface object with the real-world object instance at the second position within the bounded display area and in such a manner that it appears that the first portion and the second portion of the controllable interface object are connected together as an integrated version of the controllable interface object.   
     
     
         17 . The method of  claim 14 , wherein the method further includes terminating a display of the real-world object instance of the controllable interface object in response to generating the virtual rendering the virtual instance of the controllable interface object. 
     
     
         18 . The method of  claim 14 , wherein the method further includes animating movement of the controllable interface object as it is moved from the location within the bounded display area to the location that is at least partially outside of the bounded display area within the augmented-reality scene. 
     
     
         19 . The method of  claim 14 , wherein the method further includes:
 modifying how the virtual object instance of the controllable interface object is rendered, including (i) using a first presentation mode with a first set of display properties for rendering an unobstructed view of the virtual object instance in the augmented-reality scene either in front of and/or overlapping with the physical real-world display and (ii) using a second presentation mode with a different set of display properties for rendering an obstructed view of the virtual object instance, when the virtual object instance is displayed behind the physical real-world display in the augmented-reality scene, with a portion of the virtual object instance of the controllable interface object being omitted from view in the augmented-reality scene; and   rendering the interactive virtual object instance in the first presentation mode, subsequent displaying the virtual object instance of the controllable interface object in the second presentation mode, and in response to detecting attention directed to the virtual object instance of the controllable interface object subsequent to displaying the virtual object instance of the controllable interface object in the second presentation mode.   
     
     
         20 . The method of  claim 14 , wherein the method further includes rendering the real-world object instance of the controllable interface object with a first presentation style and to render the virtual object instance of the controllable interface object with a second presentation style that is different than the first presentation style, the first presentation style having a size, coloring or shape for rendering the real-world object instance of the controllable interface object that is different than a respective size, coloring or shape of the second presentation style for rendering the virtual object instance of the controllable interface object.