Method of Notifying Users Regarding Motion Artifacts Based on Image Analysis

Abstract

A digital image acquisition system having no photographic film comprises a portable apparatus for capturing digital images and a digital processing component for reducing camera motion blur in an image captured by the apparatus. The digital processing component operates by comparing the image with at least one other image, for example a preview image, of approximately the same scene taken outside the exposure period of the main image. In one embodiment the digital processing component identifies at least one feature which is relatively less blurred than the corresponding feature in the main image, and/or calculates a trajectory of at least one feature in a plurality of preview images and extrapolates such feature onto the main image, and calculates a PSF in respect of the feature, and de-convolves the main image using the PSF.

What is claimed is: 
     
         1 . A digital image acquisition device, comprising:
 an image capture component for capturing digital images;   an auto-focus mechanism configured to automatically focus a scene and to be used in determining a motion blur; and   a digital processing component, including:
 a processor; and 
 embedded code for programming the processor to initiate a subsequent action-upon determining that a threshold motion blur has occurred in a captured digital image based on a real time analysis of the captured digital image and at least one further image each acquired with said digital image acquisition device, such that said same digital image acquisition device captures each of said captured digital image and said at least one further image, within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of approximately the same scene as that of the captured digital image, and 
 wherein the motion blur is determined qualitatively using the auto-focus mechanism; 
 wherein said captured digital image and said at least one further image are compared; and 
 wherein the digital processing component is further arranged to determine whether to initiate said subsequent action depending on whether the threshold motion blur has occurred in the captured digital image. 
   
     
     
         2 . A device according to  claim 1 , wherein the determining that a threshold motion blur has occurred is based on qualitatively determining a motion blur. 
     
     
         3 . A device according to  claim 2 , wherein the motion blur is mathematically defined as a point spread function (PSF). 
     
     
         4 . A device according to  claim 2 , wherein said digital processing component further de-blurs the captured image using said determined motion blur function. 
     
     
         5 . A device according to  claim 2 , wherein said qualitatively determining a motion blur is performed using an auto-focus mechanism of the camera as the digital processing component. 
     
     
         6 . A device according to  claim 1 , wherein said image capture component comprises a single sensor for capturing said captured digital image and said at least one further image. 
     
     
         7 . A device according to  claim 1 , wherein said determining that a threshold motion blur has occurred in the captured digital image is further based on a comparison of said captured digital image with at least two further images each acquired with said same sensor, such that at least a same portion of said same sensor captures at least a portion of each of said captured digital image and said at least two further images, within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of approximately the same scene as that of the captured digital image. 
     
     
         8 . One or more non-transitory computer readable media having digital code embedded therein for programming a processor to perform a method on a digital image acquisition device that comprises an image capture component for capturing digital images, a digital processing component and an auto-focus mechanism, wherein the method comprises:
 qualitatively determining a motion blur at least in part using an auto focus mechanism of the device;   determining that a threshold motion blur has occurred in a captured digital image based on a real time analysis of the captured digital image and at least one further image each acquired with a same digital image acquisition device, such that said same digital image acquisition device captures each of said captured digital image and said at least one further image, within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of approximately the same scene as that of the captured digital image;   comparing said captured digital image and said at least one further image;   determining whether to initiate said subsequent image capture depending on whether the threshold motion blur has occurred in the captured digital image;   initiating said subsequent action based on the determining depending on whether the threshold motion blur has occurred in the captured digital image.   
     
     
         9 . One or more computer readable media according to  claim 8 , wherein the determining that a threshold motion blur has occurred is based on qualitatively determining a motion blur. 
     
     
         10 . One or more computer readable media according to  claim 9 , wherein the motion blur is mathematically defined as a point spread function (PSF). 
     
     
         11 . One or more computer readable media according to  claim 9 , wherein said qualitatively determining a motion blur is performed using an auto-focus mechanism of the camera as the digital processing component. 
     
     
         12 . One or more computer readable media according to  claim 8 , wherein said digital image acquisition system comprises a portable digital camera comprising a single sensor for capturing said captured digital image and said at least one further image. 
     
     
         13 . One or more computer readable media according to  claim 8 , wherein said determining that a threshold motion blur has occurred in the captured digital image is further based on a comparison of said captured digital image with at least two further images each acquired with said same sensor, such that at least a same portion of said same sensor captures at least a portion of each of said captured digital image and said at least two further images, within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of approximately the same scene as that of the captured digital image. 
     
     
         14 . On a digital image acquisition device that comprises an image capture component for capturing digital images and a digital processing component, a method of initiating a subsequent action depending on determining whether a threshold motion blur has occurred in the digital image, wherein the method comprises:
 qualitatively determining a motion blur at least in part using an auto focus mechanism of the device;   determining that a threshold motion blur has occurred in a captured digital image based on a real time analysis of the captured digital image and at least one further image each acquired with a same digital image acquisition device, such that said same digital image acquisition device captures each of said captured digital image and said at least one further image, within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of approximately the same scene as that of the captured digital image;   comparing said captured digital image and said at least one further image;   determining whether to initiate said subsequent action depending on whether the threshold motion blur has occurred in the captured digital image;   initiating said subsequent action based on the determining depending on whether the threshold motion blur has occurred in the captured digital image.   
     
     
         15 . A method according to  claim 14 , wherein the determining that a threshold motion blur has occurred is based on qualitatively determining a motion blur. 
     
     
         16 . A method according to  claim 15 , wherein the motion blur is mathematically defined as a point spread function (PSF). 
     
     
         17 . A method according to  claim 15 , wherein said qualitatively determining a motion blur is performed using an auto-focus mechanism of the camera as the digital processing component. 
     
     
         18 . A method according to  claim 14 , wherein said digital image acquisition system comprises a portable digital camera comprising a single sensor for capturing said captured digital image and said at least one further image. 
     
     
         19 . A method according to  claim 14 , wherein said determining that a threshold motion blur has occurred in the captured digital image is further based on a comparison of said captured digital image with at least two further images each acquired with said same sensor, such that at least a same portion of said same sensor captures at least a portion of each of said captured digital image and said at least two further images, within a temporal range that includes an exposure period of the captured digital image, and times proximately before and after said exposure period, and of approximately the same scene as that of the captured digital image. 
     
     
         20 . The device of  claim 1 , wherein said real time analysis occurs within the device and within a temporal duration commensurate either with an average delay between capture of consecutive images or with timing of an auto-focus mechanism of the device, or both. 
     
     
         21 . One or more computer readable media according to  claim 8 , wherein said real time analysis occurs within the device and within a temporal duration commensurate either with an average delay between capture of consecutive images or with timing of an auto-focus mechanism of the device, or both. 
     
     
         22 . A method according to  claim 14 , wherein said real time analysis occurs within the device and within a temporal duration commensurate either with an average delay between capture of consecutive images or with timing of an auto-focus mechanism of the device, or both. 
     
     
         23 . The device of  claim 1 , wherein a local contrast gradient or edge detection auto-focus technique, or both, is used to qualitatively determine the motion blur. 
     
     
         24 . One or more computer readable media according to  claim 8 , wherein a local contrast gradient or edge detection auto-focus technique, or both, is used to qualitatively determine the motion blur. 
     
     
         25 . A method according to  claim 14 , wherein a local contrast gradient or edge detection auto-focus technique, or both, is used to qualitatively determine the motion blur. 
     
     
         26 . The device of  claim 1 , wherein the threshold motion blur comprises a qualitative non-zero distortion amount around one or more points or lines or both in the image compared to one or more relatively sharp matched points or lines, or both, in the at least one further image. 
     
     
         27 . One or more computer readable media according to  claim 8 , wherein the threshold motion blur comprises a qualitative non-zero distortion amount around one or more points or lines or both in the image compared to one or more relatively sharp matched points or lines, or both, in the at least one further image. 
     
     
         28 . A method according to  claim 14 , wherein the threshold motion blur comprises a qualitative non-zero distortion amount around one or more points or lines or both in the image compared to one or more relatively sharp matched points or lines, or both, in the at least one further image.