Image processing apparatus, image processing method, non-transitory computer-readable storage medium, and image pickup apparatus for processing a picked-up image

Abstract

An image processing apparatus for processing a picked-up image which is output from an image pickup element in which a microlens array for obtaining the picked-up image including ray directional information of an object image formed by a photographing optical system has been arranged has: a refocus processing unit for executing a refocus processing of the obtained picked-up image on the basis of the ray directional information and generating a reconstruction image; and a defect pixel detection unit for detecting a defect pixel from the obtained picked-up image. When the picked-up image is obtained, the detection of the defect pixel of the obtained picked-up image is performed. When a refocus processing is instructed, the refocus processing is executed to the picked-up image in which the detection of the defect pixel is performed.

What is claimed is: 
     
         1 . An image processing apparatus for processing a picked-up image which is output from an image pickup element having a microlens array, a plurality of pixels of the image pickup element being assigned to one microlens of the microlens array, configured to pick up an image, comprising:
 one or more processors; and   at least one memory coupled to the one or more processors, the at least one memory having stored thereon instructions which, when executed by the one or more processors cause the image processing apparatus to:   obtain the picked-up image which is output from the image pickup element;   perform image processing on the obtained picked-up image based on ray directional information of the obtained picked-up image as refocus processing so as to generate a reconstruction image whose focal length is different from a focal length of the obtained picked-up image;   detect a defect pixel from the obtained picked-up image; and   control in such a manner that the detection of the defect pixel of the obtained picked-up image is performed, and the refocus processing is performed after performing the detection of the defect pixel on the picked-up image in which the detection of the defect pixel is performed.