Image processing device, image processing method, program, and imaging device

Abstract

In order to perform imaging operation control in which a defocus amount and a depth of field in any certain region of a captured image are taken into consideration, a map data generation unit configured to generate defocus map data which is calculated from phase difference information detected by a phase difference detection unit and indicates defocus amounts at a plurality of positions of a captured image by an imaging element unit; and an operation control unit configured to perform imaging operation control using the defocus map data generated by the map data generation unit are included.

1 . An image processing device comprising:
 a map data generation unit configured to generate defocus map data which is calculated from phase difference information detected by a phase difference detection unit and indicates defocus amounts at a plurality of positions of a captured image by an imaging element unit; and   an operation control unit configured to perform imaging operation control using the defocus map data generated by the map data generation unit.   
     
     
         2 . The image processing device according to  claim 1 , wherein the phase difference detection unit detects the phase difference information with an image surface phase difference pixel in the imaging element unit. 
     
     
         3 . The image processing device according to  claim 1 , further comprising:
 a display control unit configured to generate a defocus map image indicating a distribution of defocus amounts in the captured image using the defocus map data generated by the map data generation unit and perform display control.   
     
     
         4 . The image processing device according to  claim 1 , further comprising:
 a target region setting unit configured to set a target region in accordance with captured image content,   wherein the target region setting unit sets a region in a captured image designated through a user operation as the target region.   
     
     
         5 . The image processing device according to  claim 1 , further comprising:
 a target region setting unit configured to set a target region in accordance with captured image content,   wherein the map data generation unit generates the defocus map data at a plurality of positions in the target region.   
     
     
         6 . The image processing device according to  claim 5 , wherein the operation control unit performs imaging operation control using the defocus map data in the target region generated by the map data generation unit. 
     
     
         7 . The image processing device according to  claim 6 , wherein the operation control unit performs imaging operation control such that a defocus amount of the target region is a preset fixed value with reference to the defocus map data. 
     
     
         8 . The image processing device according to  claim 6 , wherein the operation control unit performs imaging operation control such that the defocus amount of the target region is a fixed value set through a user operation with reference to the defocus map data. 
     
     
         9 . The image processing device according to  claim 6 , wherein the operation control unit performs imaging operation control using the defocus map data in accordance with attribute information of the target region. 
     
     
         10 . The image processing device according to  claim 9 , wherein the attribute information is an attribute associated with the target region. 
     
     
         11 . The image processing device according to  claim 9 , wherein the attribute information is an attribute associated with a subject in the target region. 
     
     
         12 . The image processing device according to  claim 1 , wherein the imaging operation control is focus control. 
     
     
         13 . The image processing device according to  claim 3 , wherein the display control unit generates a defocus map image in a color in accordance with the defocus amount at each position of the captured image. 
     
     
         14 . The image processing device according to  claim 1 , wherein the operation control unit performs imaging operation control in response to a user operation on a defocus map image. 
     
     
         15 . The image processing device according to  claim 3 ,
 wherein the display control unit generates a defocus map image using a defocus amount display icon in which a display mode is different in accordance with the defocus amount; and   wherein the operation control unit performs imaging operation control in response to a user operation on the defocus amount display icon in the defocus map image.   
     
     
         16 . The image processing device according to  claim 4 , wherein the target region setting unit sets a face region detected through face detection in the captured image as the target region. 
     
     
         17 . The image processing device according to  claim 4 , wherein the target region setting unit sets a pupil region detected through pupil detection in the captured image as the target region. 
     
     
         18 . An image processing method comprising:
 generating defocus map data which is calculated from phase difference information detected by a phase difference detection unit and indicates defocus amounts at a plurality of positions of a captured image by an imaging element unit; and   performing imaging operation control using the generated defocus map data.   
     
     
         19 . A program causing an image processing device to perform:
 a map data generation function of generating defocus map data which is calculated from phase difference information detected by a phase difference detection unit and indicates defocus amounts at a plurality of positions of a captured image by an imaging element unit; and   an operation control function of performing imaging operation control using the defocus map data generated by the map data generation function.   
     
     
         20 . An imaging device comprising:
 an imaging element unit configured to perform imaging;   a map data generation unit configured to generate defocus map data which is calculated from phase difference information detected by a phase difference detection unit and indicates defocus amounts at a plurality of positions of a captured image by the imaging element unit; and   an operation control unit configured to perform imaging operation control using the defocus map data generated by the map data generation unit.