Augmented Reality Methods and Systems Including Optical Merging of a Plurality of Component Optical Images

Abstract

The present disclosure provides augmented reality methods and systems where two or more component optical images are optically overlaid via one or more beam splitters to form composite optical images. In some embodiments a second component optical image is an electronic optical image (an image from an electronically controlled emission source) while the first component optical image is one of a physical optical image (an image of a physical object from which diffuse reflection occurs), an electronic optical image, an emission optical image (an image from a non-electronic source that emits radiation), or a hybrid optical image (composed of at least two of a physical optical image, and electronic optical image, or an emission optical image). In some embodiments the first and second component optical images are used to provide feedback concerning the quality of the overlaying and appropriate correction factors to improve the overlay quality.

We claim: 
     
         1 . A method of providing composite optical images to an observer wherein the composite optical images are comprised of a first set of component optical images of a source or object along with a second set of component optical images configured to be displayed in relationship to the first set of component optical images, the method comprising:
 directing the first set of component optical images from a source or an object to a first beam splitter and thereafter directing a first split first component of the first set of component optical images to a first image capture viewing location path;   directing a second set of component optical images from an electronic image display device to a viewing location along a second viewing location path having at least a terminal portion that overlays a terminal portion of the first viewing location path; and   using a portion of data created from the first component optical image captured by the first image capture device in generating electronic image data that is provided to an electronic image display device to create an updated second set of component optical images.   
     
     
         2 . The method of  claim 1  wherein the second beam splitter is the same as the first beam splitter. 
     
     
         3 . The method of  claim 1  wherein the second beam splitter is different from the first beam splitter. 
     
     
         4 . The method of  claim 1  wherein the step of directing further comprises providing the first set of component optical images including physical optical images and directing light from a light source onto an object located at the beginning of the first set of optical path that gives rise to the physical optical images. 
     
     
         5 . The method of  claim 4  wherein the light form the light source comprises light selected from the group consisting of (1) visible light, (2) UV light, and (3) IR light. 
     
     
         6 . The method of  claim 5  additionally comprising providing one or more optical components between the light source and the object wherein at least one of the one or more optical components is selected from the group consisting of: (1) a lens, (2) a mirror, (3) a mechanical or electronic shutter, (4) a prism, (5) a diffraction grating, and (6) a filter. 
     
     
         7 . The method of  claim 6  additionally comprising providing one or more optical components located along a path traveled by either one or both of the first set of component optical images and the second set of component optical images, wherein the one or more optical components include at least one of: (1) a lens, (2) a mirror, (3) a shutter, (4) a prism, (5) a diffraction grating, and (6) a filter. 
     
     
         8 . The method of  7  wherein the second set of component optical images do not comprise image that are the same as the first set of component optical images. 
     
     
         9 . A method of providing composite optical images to an observer wherein the composite optical images are comprised of a first set of component optical images of an object or source along with a second set of component optical images displayed in relationship to the first set of component optical images, the method comprising:
 directing the first set of component optical images along a first optical path to a first beam splitter;   directing the first set of component optical images along a second optical path and a third optical path from the first beam splitter to a first image capture device;   generating a first set of electronic data corresponding to the first set of component optical images captured by the first image capture device and using said first electronic data set in combination with other data to provide a second electronic data set;   providing the second electronic data set to an electronic image display device to project the second set of component optical images along a fourth optical path onto a second beam splitter, and   providing a third beam splitter located along the fourth optical path, the fourth optical path being split into one branch that continues to the second beam splitter and one branch that directs the second component optical image onto a second image capture device.