Image processing method and apparatus

Abstract

There is provided an image processing apparatus for describing a real image as a virtual object using space data formed based on a photo image of the real object, and generating a virtual image of the virtual object using the space data. The image processing apparatus captures the photo image of the real object from a real camera viewpoint position while illuminating the real object by an illumination light source placed at a real illumination position. The captured photo image is converted into space data in the form of an object for each pixel, and the space data is stored in a memory together with various illumination conditions at the real illumination position to allow a search at a later time.

1 - 74 . (canceled)  
   
   
       75 . A mixed reality presentation apparatus for mixing a virtual space with a real space illuminated by a real illumination device, comprising: 
 a change unit configured to change an illumination condition of the illumination device;    an illuminating unit configured to illuminate the real space by using the illumination device, based on the illumination condition changed by said change unit;    an input unit configured to input an image of the real space;    a setting unit configured to set an illumination condition parameter value corresponding to a value of the changed illumination condition;    a generating unit configured to generate a virtual image using the condition parameter set by said setting unit; and    a mixing unit configured to mix the virtual image generated by said generating unit and the image of the real space input by said input unit.    
   
   
       76 . The apparatus according to  claim 75 , wherein the illumination condition includes one of illuminance, color and an illumination direction.  
   
   
       77 . The apparatus according to  claim 75 , wherein said change unit comprises a GUI operated by a user to display control buttons for graphically changing illuminance, color, and an illumination direction of the illumination device on a display screen.  
   
   
       78 . The apparatus according to  claim 75 , wherein said mixing unit determines occlusion by comparing depth values of the image of the real space and the virtual image, and mixes the image of the real space and the virtual image in accordance with the determined occlusion.  
   
   
       79 . A mixed reality presentation method for mixing a virtual space with a real space illuminated by a real illumination device, said method comprising: 
 a change step of changing an illumination condition of the illumination device;    an illuminating step of illuminating the real space by using the illumination device, based on the illumination condition changed in the change step;    an input step of inputting an image of the real space;    a setting step of setting an illumination condition parameter value corresponding to a value of the changed illumination condition;    a generating step of generating a virtual image using the condition parameter set in said setting step; and    a mixing step of mixing the virtual image generated in the generating step and the image of the real space input in the input step.    
   
   
       80 . A storage medium that stores a control program for making a computer execute a mixed reality presentation process for mixing a virtual space with a real space illuminated by a real illumination device, said mixed reality presentation process comprising: 
 a change step of changing an illumination condition of the illumination device;    an illuminating step of illuminating the real space by using the illumination device, based on the illumination condition changed in the change step;    an input step of inputting an image of the real space;    a setting step of setting an illumination condition parameter value corresponding to a value of the changed illumination condition;    a generating step of generating a virtual image using the condition parameter set in said setting step; and    a mixing step of mixing the virtual image generated in the generating step and the image of the real space input in the input step.