Dual reality system

Abstract

An apparatus for merging real and virtual images in which points in three dimensions of an actual scene are obtained and selected in a random fashion and in a number sufficient to track the movement of the three dimensional scene relative to an observer wearing the apparatus. Updating of selected points occurs responsive to movement of a video camera pair observing the actual scene. The position and orientation of the unit housing the video camera pair is utilized to properly merge a generated virtual image with the real image. Selection of points and orientation of the unit relative to a three dimensional real image are obtained in real time. Microprocessor-based apparatus is utilized to perform the method of the invention.

What is claimed is:  
     
       1. A wearable visual environment integration device comprising: 
       a) an image capture means, including a camera pair, for capturing an observed image from a visual perspective of a wearer wearing said integration device;  
       b) a visual navigation means for determining a position and orientation based upon a visual perspective of said wearer from said observed image  
       c) image generation means for generating a computer-generated image, and  
       d) a display means for displaying a composite image to said wearer responsive to said image capture means and said image generation means whereby said computer-generated image is visually integrated with said observed image consistent with the derived position and orientation of the visual perspective of said wearer.  
     
     
       2. The wearable visual environment integration device of  claim 1 , whereby said observed image is a stereoscopic image. 
     
     
       3. The wearable visual environment integration device of  claim 2 , wherein said computer-generated image is a stereoscopic image. 
     
     
       4. The wearable visual environment integration device of  claim 3 , wherein said composite image is stereoscopic image and displayed to said wearer stereoscopically. 
     
     
       5. The wearable visual environment integration device of  claim 4 , wherein said device is contiguous with a head of said wearer. 
     
     
       6. The wearable visual environment integration device of  claim 4 , wherein said device is conforms with a head of said wearer. 
     
     
       7. The wearable visual environment integration device of  claim 5 , wherein the movement of said device moves with the movement of the head of said wearer. 
     
     
       8. The wearable visual environment integration device of  claim 7 , further including a housing such that the movement of the head of said wearer causes a substantially similar movement of said housing. 
     
     
       9. The wearable visual environment integration device of  claim 8 , wherein said housing means substantially houses said image generation means. 
     
     
       10. The wearable visual environment integration device of  claim 8 , wherein said housing substantially houses said visual navigation means.