System and method for generating a digital image

Abstract

A system, method, and computer program product for generating a digital image. The method comprises receiving a shutter release command and causing a camera module to sample a first image of a photographic scene based on a first set of sampling parameters in response to the shutter release command. Next, the first image within an image set is stored and a camera module is caused to sample a second image of the photographic scene based on a second set of sampling parameters in response to the shutter release command. Additionally, the second image within the image set is stored, and a strobe intensity value is specified based on a measured exposure for images in the image set. Lastly, a strobe unit is configured based on the strobe intensity value, and in response to configuring the strobe unit, the camera module is caused to sample a final image.

What is claimed is: 
     
         1 . A method comprising:
 capturing multiple ambient images of a scene using at least one camera of an electronic device and without using a flash of the electronic device;   capturing multiple flash images of the scene using the at least one camera of the electronic device and during firing of a pilot flash sequence using the flash;   analyzing multiple pairs of images to estimate exposure differences obtained using the flash, wherein each pair of images includes one of the ambient images and one of the flash images that are both captured using a common camera exposure, and wherein different pairs of images are captured using different camera exposures;   determining a flash strength for the scene based on the estimate of the exposure differences; and   firing the flash based on the determined flash strength.   
     
     
         2 . The method of  claim 1 , wherein analyzing each pair of images comprises at least one of:
 identifying exposure differences between the ambient image and the flash image in the pair at a pixel level;   identifying exposure differences between the ambient image and the flash image in the pair for a foreground and a background of the images; and   identifying exposure differences between the ambient image and the flash image in the pair for one or more objects in the images.   
     
     
         3 . The method of  claim 1 , wherein determining the flash strength for the scene comprises mapping the identified exposure differences to the flash strength. 
     
     
         4 . The method of  claim 1 , further comprising:
 capturing additional images of the scene using the at least one camera of the electronic device, at least some of the additional images captured at the determined flash strength and using different camera exposures; and   blending the additional images to produce a blended image of the scene.   
     
     
         5 . The method of  claim 4 , wherein blending the additional images comprises:
 aligning the additional images;   generating exposure maps for the aligned additional images using different metrics for the different camera exposures of the additional images; and   generating motion maps for the aligned additional images or for equalized versions of the aligned additional images; and   wherein the blended image is produced using the exposure maps, synthesized images based on the aligned images, and the motion maps.   
     
     
         6 . The method of  claim 4 , wherein:
 the additional images include first, second, and third additional images; and   blending the additional images comprises:   blending a version of the first additional image and a first histogram-matched version of the second additional image to produce a fourth additional image;   blending a version of the third additional image and a second histogram-matched version of the second additional image to produce a fifth additional image; and   blending the second, fourth, and fifth additional images to produce the blended image.   
     
     
         7 . The method of  claim 4 , wherein:
 the blended image includes at least one object in the scene or a foreground of the scene illuminated using the determined flash strength; and   the at least one object in the scene or the foreground of the scene and a background of the scene have a more uniform illumination than in the additional images of the scene.   
     
     
         8 . An electronic device comprising:
 at least one camera;   a flash; and   at least one processing device configured to:
 capture multiple ambient images of a scene using the at least one camera and without using the flash; 
 capture multiple flash images of the scene using the at least one camera and during firing of a pilot flash sequence using the flash; 
 analyze multiple pairs of images to estimate exposure differences obtained using the flash, wherein each pair of images includes one of the ambient images and one of the flash images that are both captured using a common camera exposure, and wherein different pairs of images are captured using different camera exposures; 
 determine a flash strength for the scene based on the estimate of the exposure differences; and 
 fire the flash based on the determined flash strength. 
   
     
     
         9 . The electronic device of  claim 8 , wherein, to analyze each pair of images, the at least one processing device is configured to at least one of:
 identify exposure differences between the ambient image and the flash image in the pair at a pixel level;   identify exposure differences between the ambient image and the flash image in the pair for a foreground and a background of the images; and   identify exposure differences between the ambient image and the flash image in the pair for one or more objects in the images.   
     
     
         10 . The electronic device of  claim 8 , wherein, to determine the flash strength for the scene, the at least one processing device is configured to map the identified exposure differences to the flash strength. 
     
     
         11 . The electronic device of  claim 8 , wherein the at least one processing device is further configured to:
 capture additional images of the scene using the at least one camera, at least some of the additional images captured at the determined flash strength and using different camera exposures; and   blend the additional images to produce a blended image of the scene.   
     
     
         12 . The electronic device of  claim 11 , wherein, to blend the additional images, the at least one processing device is configured to:
 align the additional images;   generate exposure maps for the aligned additional images using different metrics for the different camera exposures of the additional images; and   generate motion maps for the aligned additional images or for equalized versions of the aligned additional images; and   wherein, to produce the blended image, the at least one processing device is configured to use the exposure maps, synthesized images based on the aligned images, and the motion maps.   
     
     
         13 . The electronic device of  claim 11 , wherein:
 the additional images include first, second, and third additional images; and   to blend the additional images, the at least one processing device is configured to:   blend a version of the first additional image and a first histogram-matched version of the second additional image to produce a fourth additional image;   blend a version of the third additional image and a second histogram-matched version of the second additional image to produce a fifth additional image; and   blend the second, fourth, and fifth additional images to produce the blended image.   
     
     
         14 . The electronic device of  claim 11 , wherein:
 the blended image includes at least one object in the scene or a foreground of the scene illuminated using the determined flash strength; and   the at least one object in the scene or the foreground of the scene and a background of the scene have a more uniform illumination than in the additional images of the scene.   
     
     
         15 . A non-transitory machine-readable medium containing instructions that when executed cause at least one processor of an electronic device to:
 capture multiple ambient images of a scene using at least one camera of the electronic device and without using a flash of the electronic device;   capture multiple flash images of the scene using the at least one camera of the electronic device and during firing of a pilot flash sequence using the flash;   analyze multiple pairs of images to estimate exposure differences obtained using the flash, wherein each pair of images includes one of the ambient images and one of the flash images that are both captured using a common camera exposure, and wherein different pairs of images are captured using different camera exposures;   determine a flash strength for the scene based on the estimate of the exposure differences; and   fire the flash based on the determined flash strength.   
     
     
         16 . The non-transitory machine-readable medium of  claim 15 , wherein the instructions that when executed cause the processor to analyze each pair of images comprise instructions that when executed cause the processor to at least one of:
 identify exposure differences between the ambient image and the flash image in the pair at a pixel level;   identify exposure differences between the ambient image and the flash image in the pair for a foreground and a background of the images; and   identify exposure differences between the ambient image and the flash image in the pair for one or more objects in the images.   
     
     
         17 . The non-transitory machine-readable medium of  claim 15 , wherein the instructions when executed further cause the processor to:
 capture additional images of the scene using the at least one camera, at least some of the additional images captured at the determined flash strength and using different camera exposures; and   blend the additional images to produce a blended image of the scene.   
     
     
         18 . The non-transitory machine-readable medium of  claim 17 , wherein the instructions that when executed cause the processor to blend the additional images comprise instructions that when executed cause the processor to:
 align the additional images;   generate exposure maps for the aligned additional images using different metrics for the different camera exposures of the additional images; and   generate motion maps for the aligned additional images or for equalized versions of the aligned additional images; and   wherein the instructions that when executed cause the processor to produce the blended image comprise instructions that when executed cause the processor to use the exposure maps, synthesized images based on the aligned images, and the motion maps.   
     
     
         19 . The non-transitory machine-readable medium of  claim 17 , wherein:
 the additional images include first, second, and third additional images; and   the instructions that when executed cause the processor to blend the additional images comprise instructions that when executed cause the processor to:
 blend a version of the first additional image and a first histogram-matched version of the second additional image to produce a fourth additional image; 
 blend a version of the third additional image and a second histogram-matched version of the second additional image to produce a fifth additional image; and 
 blend the second, fourth, and fifth additional images to produce the blended image. 
   
     
     
         20 . The non-transitory machine-readable medium of  claim 17 , wherein:
 the blended image includes at least one object in the scene or a foreground of the scene illuminated using the determined flash strength; and   the at least one object in the scene or the foreground of the scene and a background of the scene have a more uniform illumination than in the additional images of the scene.