Image processing apparatus and control method thereof

Abstract

Provided is an image processing apparatus that can flexibly control the position of a virtual light source used for re-lighting processing and correct shading of an object, and a control method thereof. A shading condition detection unit calculates an evaluation value representing the condition of the shading for an object region within an image. A virtual light source control unit then sets a virtual light source based on the evaluation value, and a virtual light addition unit applies the effects of virtual light irradiated by the virtual light source in the image.

1 - 27 . (canceled) 
     
     
         28 . An image processing apparatus comprising:
 at least one processor and/or circuit configured to function as the following units:   (1) an evaluation unit configured to evaluate a condition of shading for an object region in an image;   (2) a correction unit configured to apply effects of virtual light to the object region; and   (3) a determination unit configured to determine a degree of the effects of virtual light to be applied by the correction unit, based on the condition of shading that is evaluated by the evaluation unit,   wherein if there are a plurality of object regions in the image, the determination unit determines the degree of the effects of virtual light for each object region.   
     
     
         29 . The image processing apparatus according to  claim 28 , wherein if there are a plurality of object regions in the image, (1) the evaluation unit evaluates the condition of shading for each object region, and (2) the determination unit determines the degree of the effects of virtual light for each object region based on the conditions of shading. 
     
     
         30 . The image processing apparatus according to  claim 28 , wherein if there are a plurality of object regions in the image, (1) the evaluation unit evaluates the condition of shading for each object region, and (2) the determination unit determines the degree of the effects of virtual light for each object region based on one of the conditions of shading. 
     
     
         31 . The image processing apparatus according to  claim 28 , wherein the at least one processor and/or circuit is further configured to function as:
 a detection unit configured to detect a face region as the object region.   
     
     
         32 . The image processing apparatus according to  claim 31 , wherein the at least one processor and/or circuit is further configured to function as an identification unit configured to identify a normal vector of the object region, and
 wherein the determination unit determines the degree of the effects of virtual light based on the condition of shading evaluated by the evaluation unit and the normal vector identified by the identification unit.   
     
     
         33 . The image processing apparatus according to  claim 32 , wherein the detection unit further detects a specific organ in the face region, and
 wherein the identification unit identifies the normal vector of the object region based on information regarding the specific organ detected by the detection unit.   
     
     
         34 . The image processing apparatus according to  claim 32 , wherein the identification unit divides the object region into a plurality of subregions and then identifies a normal vector for each of the subregions as the normal vector of the object region. 
     
     
         35 . The image processing apparatus according to  claim 34 , wherein the determination unit determines the degree of the effects of virtual light for each of the subregions based on a corresponding normal vector. 
     
     
         36 . The image processing apparatus according to  claim 32 , wherein the at least one processor and/or circuit is further configured to function as an obtainment unit configured to obtain distance information for an object in the object region, and
 wherein the identification unit identifies the normal vector based on the distance information obtained by the obtainment unit.   
     
     
         37 . The image processing apparatus according to  claim 36 , wherein the obtainment unit captures a plurality of images by changing an in-focus distance in a focus detection process and then obtains the distance information based on the captured images. 
     
     
         38 . The image processing apparatus according to  claim 28 , wherein the degree of the effect of virtual light changes depending on an irradiated direction of the virtual light. 
     
     
         39 . The image processing apparatus according to  claim 28 , wherein the degree of the effect of virtual light changes depending on a position of a virtual light source that irradiates the virtual light. 
     
     
         40 . The image processing apparatus according to  claim 28 , wherein the image is obtained with an image sensor. 
     
     
         41 . The image processing apparatus according to  claim 28 , wherein the at least one processor and/or circuit is further configured to function as:
 an image capture unit configured to obtain the image; and   an instruction unit configured to instruct to perform an application of the effects of virtual light by the correction unit, and   wherein the correction unit applies the effects of virtual light to an image obtained by the image capture unit in a condition where the application of the effects of virtual light is instructed by the instruction unit.   
     
     
         42 . A control method of an image processing apparatus, the method comprising:
 evaluating a condition of shading for an object region in an image;   determining a degree of effects of virtual light to be applied, based on the condition of shading that is evaluated in the evaluating; and   applying the effects of virtual light to the object region based on the degree determined in the determining, and   wherein if there are a plurality of object regions in the image, the determining determines the degree of the effects of virtual light for each object region.   
     
     
         43 . A non-transitory machine-readable medium storing instructions that causes, when executed by at least one processor, the at least one processor to function as:
 an evaluation unit configured to evaluate a condition of shading for an object region in an image;   a correction unit configured to apply effects of virtual light to the object region; and   a determination unit configured to determine a degree of the effects of virtual light to be applied by the correction unit, based on the condition of shading that is evaluated by the evaluation unit,   wherein if there are a plurality of object regions in the image, the determination unit determines the degree of the effects of virtual light for each object region.