Method for representing virtual information in a real environment

Abstract

The invention relates to a method for ergonomically representing virtual information in a real environment, including the following steps: providing at least one view of a real environment and of a system setup for blending in virtual information for superimposing with the real environment in at least part of the view, the system setup comprising at least one display device, ascertaining a position and orientation of at least one part of the system setup relative to at least one component of the real environment, subdividing at least part of the view of the real environment into a plurality of regions comprising a first region and a second region, with objects of the real environment within the first region being placed closer to the system setup than objects of the real environment within the second region, and blending in at least one item of virtual information on the display device in at least part of the view of the real environment, considering the position and orientation of said at least one part of the system setup, wherein the virtual information is shown differently in the first region than in the second region with respect to the type of blending in the view of the real environment.

1 . A computing system configured to:
 determine a position and orientation of a camera capturing a view of a real environment relative to a point of interest (POI) in the real environment, wherein the POI is outside the view of the real environment;   display a computer-generated POI content at a screen position according to the position of the POI;   detect a change in at least one of the camera pose of the camera capturing the view of the real environment relative to the POI; and   in response to detecting the change in the camera pose, trigger a change in the screen position of the computer-generated POI content in accordance with an updated position and orientation of the camera relative to the POI.   
     
     
         2 . The computing system of  claim 1 , further configured to:
 detect input at the computer-generated POI content; and   in response to the detected input, perform an action related to the POI associated with the computer-generated POI content.   
     
     
         3 . The computing system of  claim 1 , wherein the screen comprises a semi-transparent screen. 
     
     
         4 . The computing system of  claim 1 , wherein the screen comprises a head-mounted display. 
     
     
         5 . The computing system of  claim 1 , further configured to:
 display additional content corresponding to the POI.   
     
     
         6 . The computing system of  claim 5 , further configured to:
 display a visually perceivable relation indication indicative of a relation between the POI and the additional content.   
     
     
         7 . The computing system of  claim 5 , wherein the additional content comprises at least one of an icon, a graphical object, text, a figure, a video, an annotation, a name, and a description of the POI or a combination thereof. 
     
     
         8 . The computing system of  claim 5 , further configured to:
 capture depth data of the real environment.   
     
     
         9 . The computing system of  claim 8 , wherein the additional content comprises a distance between a position of the POI in the real environment and a camera position when capturing the view of the real environment. 
     
     
         10 . The computing system of  claim 1 , wherein the computer-generated POI comprises a visual directional hint indicative of the position and orientation of the camera relative to the POI, and further in response to detecting the change in the camera pose, update the visual directional hint in accordance with the updated position and orientation of the camera relative to the POI. 
     
     
         11 . A method comprising:
 determining a position and orientation of a camera capturing a view of a real environment relative to a point of interest (POI) in the real environment, wherein the POI is outside the view of the real environment;   displaying a computer-generated POI content at a screen position according to the position of the POI;   detecting a change in at least one of the camera pose of the camera capturing the view of the real environment relative to the POI; and   in response to detecting the change in the camera pose, triggering a change in the screen position of the computer-generated POI content in accordance with an updated position and orientation of the camera relative to the POI.   
     
     
         12 . The method of  claim 11 , further comprising:
 detecting input at the computer-generated POI content; and   in response to the detected input, performing an action related to the POI associated with the computer-generated POI content.   
     
     
         13 . The method of  claim 11 , wherein the screen comprises a semi-transparent screen. 
     
     
         14 . The method of  claim 11 , wherein the screen comprises a head-mounted display. 
     
     
         15 . The method of  claim 11 , further comprising:
 displaying additional content corresponding to the POI.   
     
     
         16 . The method of  claim 15 , further comprising:
 displaying a visually perceivable relation indication indicative of a relation between the POI and the additional content.   
     
     
         17 . The method of  claim 15 , wherein the additional content comprises at least one of an icon, a graphical object, text, a figure, a video, an annotation, a name, and a description of the POI or a combination thereof. 
     
     
         18 . The method of  claim 15 , further comprising:
 capturing depth data of the real environment.   
     
     
         19 . The method of  claim 18 , wherein the additional content comprises a distance between a position of the POI in the real environment and a camera position when capturing the view of the real environment. 
     
     
         20 . The method of  claim 11 , wherein the computer-generated POI comprises a visual directional hint indicative of the position and orientation of the camera relative to the POI, and further in response to detecting the change in the camera pose, update the visual directional hint in accordance with the updated position and orientation of the camera relative to the POI.