Image Processing Method and Apparatus

Abstract

An image processing technique includes acquiring a main image of a scene and determining one or more facial regions in the main image. The facial regions are analysed to determine if any of the facial regions includes a defect. A sequence of relatively low resolution images nominally of the same scene is also acquired. One or more sets of low resolution facial regions in the sequence of low resolution images are determined and analysed for defects. Defect free facial regions of a set are combined to provide a high quality defect free facial region. At least a portion of any defective facial regions of the main image are corrected with image information from a corresponding high quality defect free facial region.

What is claimed is: 
     
         1 . A computerized method comprising:
 receiving a plurality of images of approximately a same scene;   detecting at least a first object and a second object within a first image from among the plurality of images;   detecting at least a third object and a fourth object within a second image from among the plurality of images;   tracking the first object in the first image as corresponding to the third object in the second image;   tracking the second object in the first image as corresponding to the fourth object in the second image;   wherein each of the first object, the second object, the third object, and the fourth object is distinguishable from each other.   
     
     
         2 . The method of  claim 1 , further comprising:
 detecting at least a fifth object within a third image from among the plurality of images based on the tracking of the first object and the tracking of the second object;   identifying the fifth object as corresponding to either the first object and the third object or the second object and the fourth object.   
     
     
         3 . The method of  claim 2 , further comprising:
 when the fifth object corresponds to the first object and the third object, correcting the third image by replacing at least the fifth object within the third image with the first object and the third object;   when the fifth object corresponds to the second object and the fourth object, correcting the third image by replacing at least the fifth object within the third image with the second object and the fourth object.   
     
     
         4 . The method of  claim 2 , wherein the first image, the second image, or the third image has at least one of a different focus setting, exposure level, or resolution from each other. 
     
     
         5 . The method of  claim 1 , further comprising:
 extracting the first object and the second object from the first image;   extracting the third object and the fourth object from the second image;   storing the first object and the third object in a first data store;   storing the second object and the fourth object in a second data store.   
     
     
         6 . The method of  claim 1 , wherein the tracking of the first object comprises identifying a first location of the first object within the first image and a third location of the third object within the second image. 
     
     
         7 . The method of  claim 1 , wherein the first object comprises a face, a portion of a face, a facial feature, an eye, a mouth, a nose, a part of an eye, an eye lid, an eye brow, a pupil, an iris, an ear, a chin, a beard, a mustache, a forehead, or a hairstyle. 
     
     
         8 . An apparatus comprising:
 a memory including a plurality of images of approximately a same scene;   a processor in communication with the memory, the processor configured to:
 detect at least a first object and a second object within a first image from among the plurality of images; 
 detect at least a third object and a fourth object within a second image from among the plurality of images; 
 track the first object in the first image as corresponding to the third object in the second image; 
 track the second object in the first image as corresponding to the fourth object in the second image; 
 wherein each of the first object, the second object, the third object, and the fourth object is distinguishable from each other. 
   
     
     
         9 . The apparatus of  claim 8 , wherein the processor is further configured to:
 detect at least a fifth object within a third image from among the plurality of images based on the tracking of the first object and the tracking of the second object;   identify the fifth object as corresponding to either the first object and the third object or the second object and the fourth object.   
     
     
         10 . The apparatus of  claim 9 , wherein the processor is further configured to:
 when the fifth object corresponds to the first object and the third object, correct the third image by replacing at least the fifth object within the third image with the first object and the third object;   when the fifth object corresponds to the second object and the fourth object, correct the third image by replacing at least the fifth object within the third image with the second object and the fourth object.   
     
     
         11 . The apparatus of  claim 9 , wherein the first image, the second image, or the third image has at least one of a different focus setting, exposure level, or resolution from each other. 
     
     
         12 . The apparatus of  claim 8 , wherein the processor is further configured to:
 extract the first object and the second object from the first image;   extract the third object and the fourth object from the second image;   store the first object and the third object in a first data store included in the memory;   store the second object and the fourth object in a second data store included in the memory.   
     
     
         13 . The apparatus of  claim 8 , wherein the processor tracks the first object by identifying a first location of the first object within the first image and a third location of the third object within the second image. 
     
     
         14 . The apparatus of  claim 8 , wherein the first object comprises a face, a portion of a face, a facial feature, an eye, a mouth, a nose, a part of an eye, an eye lid, an eye brow, a pupil, an iris, an ear, a chin, a beard, a mustache, a forehead, or a hairstyle. 
     
     
         15 . The apparatus of  claim 8 , further comprising a lens and an image sensor to acquire the plurality of images. 
     
     
         16 . A computerized method comprising:
 receiving a plurality of images of approximately a same scene;   detecting at least a first object within a first image from among the plurality of images;   tracking the first object within the first image to be a second object within a second image from among the plurality of images;   tracking the second object within the second image to be a third object within a third image from among the plurality of images.   
     
     
         17 . The method of  claim 16 , wherein the tracking of the second object comprises detecting the third object within the third image based on the first object or the second object. 
     
     
         18 . The method of  claim 16 , further comprising replacing the third object within the third image with the first object and the second object. 
     
     
         19 . The method of  claim 16 , wherein the tracking of the first object comprises identifying a first location of the first object within the first image and a second location of the second object within the second image. 
     
     
         20 . The method of  claim 16 , wherein the first image, the second image, or the third image has at least one of a different focus setting, exposure level, or resolution from each other. 
     
     
         21 . The method of  claim 16 , wherein the first object, the second object, and the third object comprise a same object. 
     
     
         22 . An apparatus comprising:
 a memory including a plurality of images of approximately a same scene;   a processor in communication with the memory, the processor configured to:
 detect at least a first object within a first image from among the plurality of images; 
 track the first object within the first image to be a second object within a second image from among the plurality of images; 
 track the second object within the second image to be a third object within a third image from among the plurality of images. 
   
     
     
         23 . The apparatus of  claim 22 , wherein the processor tracks the second object to detect the third object within the third image based on the first object or the second object. 
     
     
         24 . The apparatus of  claim 22 , wherein the processor replaces the third object within the third image with the first object and the second object. 
     
     
         25 . The apparatus of  claim 22 , wherein the third object comprises a face, a portion of a face, a facial feature, an eye, a mouth, a nose, a part of an eye, an eye lid, an eye brow, a pupil, an iris, an ear, a chin, a beard, a mustache, a forehead, or a hairstyle.