Image processing apparatus and image processing method

Abstract

It is required to carry out a tapping operation on a display screen to adjust the focus in a case where refocus process is performed in shifting to a reproduction mode, so that a user has to do an extra work. An image processing apparatus obtains a multi-view image data obtained by image-capturing in a plurality of viewpoints. A mode indicating information on a target to be focused is set. A combined image data focused on the target is generated by executing image processing to the multi-view image data based on the set mode.

1 .- 11 . (canceled) 
     
     
         12 . An image processing apparatus for outputting an image to be displayed by a display unit, the apparatus comprising:
 a holding unit configured to hold a refocus image generated by performing image processing on multi-view image data indicating a plurality of images obtained by performing image-capturing from a plurality of different viewpoints, wherein the refocus image is an image with a focus adjusted from a focus of an image indicated by the multi-view image data after the image-capturing;   a setting unit configured to set a refocus mode indicating a kind of target to be focused in a refocus image to be displayed by the display unit; and   an outputting unit configured to read from the holding unit and output to the display unit, a refocus image which is focused on a target indicated by the refocus mode set by the setting unit.   
     
     
         13 . The image processing apparatus according to  claim 12 , further comprising a generating unit configured to generate the refocus image corresponding to the refocus mode set by the setting unit,
 wherein the holding unit holds the refocus image generated by the generating unit, and   wherein the outputting unit reads from the holding unit and outputs to the display unit, the refocus image generated by the generating unit.   
     
     
         14 . The image processing apparatus according to  claim 12 , further comprising a detecting unit configured to detecting an object of the kind indicated by the refocus mode set by the setting units in an image represented by the multi-view image data,
 wherein the outputting unit reads from the holding unit and output to the display unit, the refocus image which is focused on a target indicated by the refocus mode set by the setting unit, in a case where the object of the kind indicated by the refocus mode set by the setting unit is detected by the detecting unit.   
     
     
         15 . The image processing apparatus according to  claim 14 , further comprising a generating unit configured to generate the refocus image corresponding to the refocus mode set by the setting unit,
 wherein the generating unit generates the refocus image which is focused on a target indicated by the refocus mode set by the setting unit in a case where the object of the kind indicated by the refocus mode set by the setting unit is detected by the detecting unit   wherein the holding unit holds the refocus image generated by the generating unit, and   wherein the outputting unit reads from the holding unit and outputs to the display unit, the refocus image generated by the generating unit.   
     
     
         16 . The image processing apparatus according to  claim 14 , wherein the holding unit further holds a deep-focus image generated from the multi-view image data and the outputting unit outputs the deep-focus image instead of the refocus image which is focused on a target indicated by the refocus mode set by the setting unit in a case where the object of the kind indicated by the refocus mode is not detected in the image represented by the multi-view image data. 
     
     
         17 . The image processing apparatus according to  claim 12 , wherein the outputting unit outputs to the display unit, in a case where an image to be displayed by the display unit is switched from a first refocus image corresponding to a first imaging scene to a second refocus image corresponding to a second imaging scene different from the first imaging scene, as the second refocus image, a refocus image focused on a target indicated by the same refocus mode as the first refocus image. 
     
     
         18 . The image processing apparatus according to  claim 12 , further comprising the display unit configured to display the refocus image output by the outputting unit. 
     
     
         19 . An image processing apparatus for outputting an image to be displayed by a display unit, the apparatus comprising:
 an obtaining unit configured to obtain multi-view image data indicating a plurality of images obtained by performing image-capturing from a plurality of different viewpoints;   a setting unit configured to set a refocus mode indicating a kind of target to be focused in a refocus image to be displayed by the display unit wherein the refocus image is an image with a focus adjusted from a focus of an image indicated by the multi-view image data after the image-capturing;   a generating unit configured to generate, based on the refocus mode set by the setting unit, a refocus image which is focused on a target of a kind indicated by the refocus mode set by the setting unit by performing image processing on the multi-view image data;   an outputting unit configured to output the refocus image generated by the generating unit to the display unit.   
     
     
         20 . An image processing apparatus for outputting an image to be displayed by a display unit, the apparatus comprising:
 a holding unit configured to hold a refocus image generated by performing image processing on multi-view image data indicating a plurality of images obtained by performing image-capturing from a plurality of different viewpoints, wherein the refocus image is an image with a focus adjusted from a focus of an image indicated by the multi-view image data after the image-capturing; and   an outputting unit configured to read the refocus image from the holding unit and output the refocus image to the display unit,   wherein the outputting unit outputs to the display unit, in a case where an image to be displayed by the display unit is switched from a first refocus image corresponding to a first imaging scene to a second refocus image corresponding to a second imaging scene different from the first imaging scene, as the second refocus image, a refocus image focused on a subject of a same kind as a subject focused on in the first refocus image.   
     
     
         21 . An image processing method for outputting an image to be displayed by a display unit, the method comprising the steps of:
 holding a refocus image generated by performing image processing on multi-view image data indicating a plurality of images obtained by performing image-capturing from a plurality of different viewpoints, wherein the refocus image is an image with a focus adjusted from a focus of an image indicated by the multi-view image data after the image-capturing;   setting a refocus mode indicating a kind of target to be focused in a refocus image to be displayed by the display unit; and   outputting a refocus image which is focused on a target indicated by the set refocus mode to the display unit.   
     
     
         22 . An image processing method for outputting an image to be displayed by a display unit, the method comprising the steps of:
 obtaining multi-view image data indicating a plurality of images obtained by performing image-capturing from a plurality of different viewpoints;   setting a refocus mode indicating a kind of target to be focused in a refocus image to be displayed by the display unit wherein the refocus image is an image with a focus adjusted from a focus of an image indicated by the multi-view image data after the image-capturing;   generating, based on the set refocus mode, a refocus image which is focused on a target of a kind indicated by the set refocus mode by performing image processing on the multi-view image data;   outputting the generated refocus image to the display unit.   
     
     
         23 . An image processing method for outputting an image to be displayed by a display unit, the method comprising the steps of:
 holding a refocus image generated by performing image processing on multi-view image data indicating a plurality of images obtained by performing image-capturing from a plurality of different viewpoints, wherein the refocus image is an image with a focus adjusted from a focus of an image indicated by the multi-view image data after the image-capturing; and   outputting the refocus image to the display unit,   wherein the outputting outputs to the display unit, in a case where an image to be displayed by the display unit is switched from a first refocus image corresponding to a first imaging scene to a second refocus image corresponding to a second imaging scene different from the first imaging scene, as the second refocus image, a refocus image focused on a subject of a same kind as a subject focused on in the first refocus image.   
     
     
         24 . A non-transitory computer-readable storage medium containing a program causing a computer to execute the image processing method according to  claim 21 . 
     
     
         25 . A non-transitory computer-readable storage medium containing a program causing a computer to execute the image processing method according to  claim 22 . 
     
     
         26 . A non-transitory computer-readable storage medium containing a program causing a computer to execute the image processing method according to  claim 23 .