Image superposition of virtual objects in a camera image

Abstract

A method superposes a virtual graphical object on a camera image of a real item. The camera image is displayed by a display device. The method takes into consideration when superposing virtual graphical objects also the real items imaged in the camera image. To this end, a distance of the item from the display device is captured by a capturing device. By way of object data, a virtual object distance of the object from the display device is given. The object is only superposed on the camera image if the object distance is less than the captured distance of the item.

1 . A method for superposing a virtual graphical object on a camera image of a real item, comprising:
 describing the virtual graphical object by digital object data;   capturing a distance from the real item to a display device by a capturing device, the distance of the real item being captured to produce a captured distance;   defining by way of the object data, a virtual object distance from the virtual graphical object to the display device;   displaying the camera image by the display device; and   superposing the virtual graphical object on the camera image, so as to insert at least part of the virtual graphical object in the camera image, only if the virtual object distance is less than the captured distance.   
     
     
         2 . The method according to  claim 1 , wherein
 a three-dimensional surface contour of the real item is captured by the capturing device,   the virtual graphical object has a three-dimensional form,   the object data describes the three-dimensional form of the virtual graphical object,   it is ascertained using an analysis device by way of a geometric section of the surface contour with the three-dimensional form, which part of the virtual graphical object protrudes from the surface contour, and   only the part which protrudes is displayed by the display device.   
     
     
         3 . The method according to  claim 1 , wherein
 a three-dimensional surface contour of the real item is captured by the capturing device,   the virtual graphical object has a three-dimensional form,   the object data describes the three-dimensional form of the virtual graphical object,   the surface contour of the real item is compared with the three-dimensional form of the virtual graphical object to identify a protruding part of the virtual graphical object which protrudes from the surface contour of the real item, and   only the protruding part is displayed by the display device.   
     
     
         4 . The method according to  claim 1 , wherein the capturing device is a device selected from the group consisting of a time-of-flight camera, a stereocamera and a laser scanner. 
     
     
         5 . The method according to  claim 1 , wherein
 the display device is integrated in data glasses,   a spatial position of the data glasses is ascertained, and   in the object data, a representation size and/or a perspective distortion of the virtual graphical object is set in dependence on the spatial position.   
     
     
         6 . The method according to  claim 1 , wherein the virtual object distance is defined in dependence on the captured distance. 
     
     
         7 . The method according to  claim 1 , wherein
 defining the virtual object distance comprises setting the virtual object distance to be less than the captured distance.   
     
     
         8 . The method according to  claim 1 , wherein
 the camera image comprises an image of first and second real items,   the virtual object distance of the virtual graphical object is set to correspond with, and be less than, the captured distance of the first real item,   the second real item has a position and captured distance that varies independently of the position and virtual object distance of the virtual graphical object, and   to the extent that the second real item is positioned between the virtual graphical object and the capturing device, the virtual graphical object is not displayed.   
     
     
         9 . The method according to  claim 1 , wherein the capturing device captures the distance of the real item from eyes of a viewing user. 
     
     
         10 . The method according to  claim 1 , wherein
 the object data specifies an absolute spatial position of the virtual graphical object, and   the virtual object distance is derived from the absolute spatial position so as to be less than the captured distance.   
     
     
         11 . The method according to  claim 1 , wherein the virtual graphical object comprises a text or graphical notification. 
     
     
         12 . A presentation apparatus to present a feature of a product, comprising:
 a memory to store digital object data that describes the feature using a virtual graphical object;   a display device;   a capturing device to capture as a captured distance, a distance from a real item to the display device; and   a control device to define by way of the object data, a virtual object distance from the virtual graphical object to the display device, to display on the display device a camera image of the real item, and to superpose the virtual graphical object on the camera image, so as to insert at least a part of the virtual graphical object in the camera image, only if the virtual object distance is less than the captured distance.   
     
     
         13 . The presentation apparatus according to  claim 12 , wherein
 the real item comprises a mockup of basic equipment of the product,   the mockup is arranged in a capturing region so as to be included in the camera image, and   the control device displays on the display device, the virtual graphical object superposed on the mockup.   
     
     
         14 . The presentation apparatus according to  claim 12 , wherein the display device, the capturing device and a camera to obtain the camera image are integrated into data glasses worn by a viewing user. 
     
     
         15 . The presentation apparatus according to  claim 12 , wherein
 the real item comprises a hand of a viewing user,   the virtual graphical object comprises a movable device, and   the virtual object distance is set to be less than the captured distance so the hand of the viewing user virtually moves the virtual graphical object.   
     
     
         16 . The presentation apparatus according to  claim 12 , wherein
 the real item comprises a hand of a viewing user, and   the virtual graphical object is animated based on changes in a position of the hand of the viewing user.   
     
     
         17 . The presentation apparatus according to  claim 12 , wherein
 the mockup comprises a dash panel without operating elements, and   the virtual graphical object comprises at least one of a controllable blower outlet, an infotainment system, an instrument cluster, operating elements on a steering wheel and display elements on the steering wheel.