US2005018923A1PendingUtilityA1

Digital image processing method having an exposure correction based on recognition of areas corresponding to the skin of the photographed subject

Assignee: ST MICROELECTRONICS SAPriority: May 19, 2003Filed: May 18, 2004Published: Jan 27, 2005
Est. expiryMay 19, 2023(expired)· nominal 20-yr term from priority
H04N 1/6027G06V 40/162G06T 5/40G06T 5/90
49
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

A digital image processing method includes extracting chromatic information of an image taken by an image taking device and related to a human subject; detecting visually interesting regions; and exposure correcting of the taken image by normalizing a grey scale of the taken image based on the visually interesting regions. Advantageously, the method includes recognizing areas corresponding to the skin of the subject, these areas being used as the visually interesting regions for the exposure correction step.

Claims

exact text as granted — not AI-modified
1 . A digital image processing method, comprising the steps of: 
 extracting chromatic information of an image taken by an image taking device and related to a human subject;    detecting visually interesting regions in the taken image by recognizing areas corresponding to skin of the subject, wherein the recognized areas are the visually interesting regions; and    correcting an exposure of said taken image by normalizing a grey scale of said taken image based on said visually interesting regions.    
   
   
       2 . A digital image processing method according to  claim 1 , wherein said recognizing step comprises constructing a probabilistic slicing of said image taken in a YcrCb format to evaluate if pixels of said image must be classified as belonging to said areas corresponding to the skin of said subject.  
   
   
       3 . A digital image processing method according to  claim 2 , wherein pixels with higher grey values are classified as belonging to said areas corresponding to the skin of said photographed subject.  
   
   
       4 . A digital image processing method according to  claim 1 , wherein said recognizing step comprises applying a threshold area of said image taken in an RGB format to evaluate if pixels of said image must be classified as belonging to said areas corresponding to the skin of said subject.  
   
   
       5 . A digital image processing method according to  claim 4 , wherein applying said threshold area comprises constructing a chrominance slicing histogram of said taken image.  
   
   
       6 . A digital image processing method according to  claim 5 , wherein constructing said chrominance slicing histogram uses normalized channels r and g of the type:  
         r=R /( R+G+B )    g=G /( R+G+B )  
     R, G and B being red, green and blue values of each pixel of said taken RGB image.  
   
   
       7 . A digital image processing method according to  claim 5 , wherein said recognizing step uses said chrominance slicing histogram to detect said areas corresponding to the skin of said subject formed by the pixels of said taken image belonging in said chrominance slicing histogram to said threshold area.  
   
   
       8 . A digital image processing method according to  claim 5 , wherein said taken image is of a Bayer type, the method further comprising: 
 sub-sampling the image according to G*=(G1+G2)/2, wherein G1 and G2 are first and second green channels of the image, and said step of constructing said chrominance slicing histogram uses normalized channels r and g of the type:        r=R /( R+G*+B )    g=G */( R+G*+B ),    R, G and B being red, green and blue values of each pixel of said taken RGB image.    
   
   
       9 . A digital image processing method according to  claim 1 , wherein said taken image is of a Bayer type.  
   
   
       10 . A digital image processing method according to  claim 9 , wherein said exposure correction of said taken image uses: 
 a simulated response function of a type:              f   ⁡     (   q   )       =     255       (     1   +     ⅇ     -     (   Aq   )           )     C               A and C being predetermined control parameters and q being a light quantity value expressed in base 2 logarithmic units; and    a grey average level (avg) calculated on said visually interesting regions, in order to calculate a distance Δ of an ideal exposure situation using:      Δ=ƒ −1 (128)−ƒ −1 (avg)    and in order to change a luminance value Y(x, y) of a pixel with position (x, y) in:        Y ′( x,y )=ƒ(ƒ −1 ( Y ( x,y ))+Δ).    
   
   
       11 . A digital image processing method according to  claim 1 , further comprising a final color reconstruction step.  
   
   
       12 . A digital image processing method according to  claim 11 , said image being taken in an RGB format, wherein said final color reconstruction step comprises the relations:  
     
       
         
           
             
               
                 
                   
                     R 
                     ′ 
                   
                   = 
                   
                     0.5 
                     · 
                     
                       ( 
                       
                         
                           
                             
                               Y 
                               ′ 
                             
                             Y 
                           
                           · 
                           
                             ( 
                             
                               R 
                               + 
                               Y 
                             
                             ) 
                           
                         
                         + 
                         R 
                         - 
                         Y 
                       
                       ) 
                     
                   
                 
               
             
             
               
                 
                   
                     G 
                     ′ 
                   
                   = 
                   
                     0.5 
                     · 
                     
                       ( 
                       
                         
                           
                             
                               Y 
                               ′ 
                             
                             Y 
                           
                           · 
                           
                             ( 
                             
                               G 
                               + 
                               Y 
                             
                             ) 
                           
                         
                         + 
                         G 
                         - 
                         Y 
                       
                       ) 
                     
                   
                 
               
             
             
               
                 
                   
                     B 
                     ′ 
                   
                   = 
                   
                     0.5 
                     · 
                     
                       ( 
                       
                         
                           
                             
                               Y 
                               ′ 
                             
                             Y 
                           
                           · 
                           
                             ( 
                             
                               B 
                               + 
                               Y 
                             
                             ) 
                           
                         
                         + 
                         B 
                         - 
                         Y 
                       
                       ) 
                     
                   
                 
               
             
           
         
       
     
     R, G, B, and Y being respective red, green, blue, and luminance values of said taken image, Y′ being a desired luminance value, and R′, G′, and B′ being respective red, green, and blue values of the image after said final color reconstruction step.  
   
   
       13 . A digital image processing method according to  claim 11 , said image being taken in a Bayer Pattern format, wherein said final color reconstruction step provides that a grey value I(x, y) of a pixel with position (x, y) is changed in:  
         I ′( x,y )=ƒ(ƒ −1 ( I ( x,y ))+Δ),  
     where Δ is a distance of an ideal exposure situation.  
   
   
       14 . A digital image processing method, comprising: 
 extracting chromatic information from an image of a human subject;    detecting, based on the extracted chromatic information, which areas of the image correspond to skin of the subject; and    normalizing grey scale values of the image based on the areas of the image that are detected as corresponding to the skin of the subject.    
   
   
       15 . The method of  claim 14 , wherein the detecting step comprises constructing a probabilistic slicing of the image taken in a YcrCb format to evaluate if pixels of the image belong to the areas corresponding to the skin of the subject.  
   
   
       16 . The method of  claim 14 , wherein the detecting step comprises applying a threshold area of the image taken in an RGB format to evaluate if pixels of the image belong to the areas corresponding to the skin of the subject.  
   
   
       17 . The method of  claim 16 , wherein applying the threshold area comprises constructing a chrominance slicing histogram of the image and using the chrominance slicing histogram to detect the areas corresponding to the skin of the subject formed by the pixels of the image belonging in the chrominance slicing histogram to the threshold area.  
   
   
       18 . The method of  claim 16 , wherein applying the threshold area comprises constructing a chrominance slicing histogram of the image using normalized channels r and g of the type:  
         r=R /( R+G+B )    g=G /( R+G+B )  
     R, G and B being red, green and blue values of each pixel of the image.  
   
   
       19 . The method of  claim 16 , wherein applying the threshold area comprises constructing a chrominance slicing histogram of the image and the image is of a Bayer type, the method further comprising: 
 sub-sampling the image according to G*=(G1+G2)/2, wherein G1 and G2 are first and second green channels of the image, and said step of constructing said chrominance slicing histogram uses normalized channels r and g of the type:        r=R /( R+G*+B )    g=G */( R+G*+B ),    R, G and B being red, green and blue values of each pixel of said taken RGB image.    
   
   
       20 . The method of  claim 14 , wherein the normalizing step performs exposure correction of the image that includes: 
 using a simulated response function of a type:              f   ⁡     (   q   )       =     255       (     1   +     ⅇ     -     (   Aq   )           )     C               A and C being predetermined control parameters and q being a light quantity value expressed in base 2 logarithmic units; and    calculating a grey average level (avg) of the areas corresponding to the skin;    calculating a distance Δ of an ideal exposure situation using:      Δ=ƒ −1 (128)−ƒ −1 (avg); and    changing a luminance value Y(x, y) of a pixel with position (x, y) in:        Y ′( x, y )=ƒ(ƒ −1 ( Y ( x, y ))+Δ).    
   
   
       21 . The method of  claim 14 , further comprising a final color reconstruction step using the relations:  
     
       
         
           
             
               
                 
                   
                     R 
                     ′ 
                   
                   = 
                   
                     0.5 
                     · 
                     
                       ( 
                       
                         
                           
                             
                               Y 
                               ′ 
                             
                             Y 
                           
                           · 
                           
                             ( 
                             
                               R 
                               + 
                               Y 
                             
                             ) 
                           
                         
                         + 
                         R 
                         - 
                         Y 
                       
                       ) 
                     
                   
                 
               
             
             
               
                 
                   
                     G 
                     ′ 
                   
                   = 
                   
                     0.5 
                     · 
                     
                       ( 
                       
                         
                           
                             
                               Y 
                               ′ 
                             
                             Y 
                           
                           · 
                           
                             ( 
                             
                               G 
                               + 
                               Y 
                             
                             ) 
                           
                         
                         + 
                         G 
                         - 
                         Y 
                       
                       ) 
                     
                   
                 
               
             
             
               
                 
                   
                     B 
                     ′ 
                   
                   = 
                   
                     0.5 
                     · 
                     
                       ( 
                       
                         
                           
                             
                               Y 
                               ′ 
                             
                             Y 
                           
                           · 
                           
                             ( 
                             
                               B 
                               + 
                               Y 
                             
                             ) 
                           
                         
                         + 
                         B 
                         - 
                         Y 
                       
                       ) 
                     
                   
                 
               
             
           
         
       
     
     R, G, B, and Y being respective red, green, blue, and luminance values of the image, Y′ being a desired luminance value, and R′, G′, and B′ being respective red, green, and blue values of the image after the final color reconstruction step.  
   
   
       22 . The method of  claim 14 , further comprising a final color reconstruction step that changes a grey value I(x, y) of a pixel with position (x, y) using:  
         I ′( x,y )=ƒ(ƒ −1 ( I ( x,y ))+Δ),  where Δ is a distance of an ideal exposure situation.    
   
   
       23 . A digital image processor, comprising: 
 means for extracting chromatic information from an image of a human subject;    means for detecting, based on the extracted chromatic information, which areas of the image correspond to skin of the subject; and    means for normalizing grey scale values of the image based on the areas of the image that are detected as corresponding to the skin of the subject.

Join the waitlist — get patent alerts

Track US2005018923A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.