Image processing device, method of controlling image processing device and program causing computer to execute method

Abstract

There is provided an image processing device including an image acquisition part acquiring an image; a depth acquisition part acquiring a depth associated with a pixel in the image; a depth conversion part converting the depth in accordance with a function having a characteristic to nonlinearly approach a predetermined value with an increase in the depth; and a storage part storing the converted depth in association with the image.

1 . (canceled) 
     
     
         2 . A device comprising:
 a memory; and   circuitry, coupled with the memory, configured to
 set an initial value of a coefficient of a function used to convert depth associated with a pixel within image data to have a nonlinear characteristic with an increase in the depth, 
 modify the initial value of the coefficient to a second value based on a shooting mode, and 
 convert the depth associated with the pixel within the image data to have the nonlinear characteristic with the increase in the depth, based the initial value or the second value, the nonlinear characteristic being different between the plurality of shooting modes, and different shooting modes having different converted depths. 
   
     
     
         3 . The device according to  claim 2 , wherein the circuitry is configured to modify the initial value of the coefficient to the second value that is smaller than the initial value, after setting the initial value of the coefficient and in response to the shooting mode being a first shooting mode. 
     
     
         4 . The device according to  claim 2 , wherein the circuitry is configured to modify the initial value of the coefficient to the second value that is greater than the initial value, after setting the initial value of the coefficient and in response to the shooting mode being a second shooting mode. 
     
     
         5 . The device according to  claim 2 , wherein the circuitry is further configured to perform smoothing processing on the image data to a degree depending on the converted depth corresponding to the pixel in the image data based on a converted depth corresponding to a predetermined pixel in the image data. 
     
     
         6 . The device according to  claim 5 , wherein the circuitry
 converts the depth associated with the pixel within the image data in accordance with the function to nonlinearly approach a predetermined value with the increase in the depth, the function being a function with a characteristic that varies depending on the coefficient, and   performs the smoothing processing based on the depth converted in accordance with the characteristic.   
     
     
         7 . The device according to  claim 2 , wherein the function is an exponential function defined by the following formula:
 Y=α×e{circumflex over ( )}(−βx), where x is the depth, y is an output, e is a base of natural logarithm, α is a predetermined constant and β is the coefficient.   
     
     
         8 . The device according to  claim 2 , wherein the function is an exponential function defined by the following formula:
 Y=α×{1−e{circumflex over ( )}(−βx)}, where x is the depth, y is an output, e is a base of natural logarithm, α is a predetermined constant and β is the coefficient.   
     
     
         9 . The device according to  claim 2 , wherein the circuitry is further configured to create an aggregation of pixels as a depth image, each pixel having the converted depth value as a pixel value. 
     
     
         10 . The device according to  claim 9 , wherein
 the circuitry is further configured to compress the depth image in accordance with a predetermined image compression format, and   the circuitry is configured to store the compressed depth image in association with the image data.   
     
     
         11 . A method comprising:
 setting an initial value of a coefficient of a function used to convert depth associated with a pixel within image data to have a nonlinear characteristic with an increase in the depth;   modifying the initial value of the coefficient to a second value based on a shooting mode; and   converting the depth associated with the pixel within the image data to have the nonlinear characteristic with the increase in the depth, based on the initial value or the second value, the nonlinear characteristic being different between the plurality of shooting modes, and different shooting modes having different converted depths.   
     
     
         12 . The method according to  claim 11 , wherein the modifying modifies the initial value of the coefficient to the second value that is smaller than the initial value, after setting the initial value of the coefficient and in response to the shooting mode being a first shooting mode. 
     
     
         13 . The method according to  claim 11 , wherein the modifying modifies the initial value of the coefficient to the second value that is greater than the initial value, after setting the initial value of the coefficient and in response to the shooting mode being a second shooting mode. 
     
     
         14 . The method according to  claim 11 , further comprising performing smoothing processing on the image data to a degree depending on the converted depth corresponding to the pixel in the image data based on a converted depth corresponding to a predetermined pixel in the image data. 
     
     
         15 . The method according to  claim 14 , wherein
 the converting converts the depth associated with the pixel within the image data in accordance with the function to nonlinearly approach a predetermined value with the increase in the depth, the function being a function with a characteristic that varies depending on the coefficient, and   the performing performs the smoothing processing based on the depth converted in accordance with the characteristic.   
     
     
         16 . A non-transitory computer-readable storage medium including computer executable instructions, wherein the instructions, when executed by a computer, cause the computer to perform a method, the method comprising:
 setting an initial value of a coefficient of a function used to convert depth associated with a pixel within image data to have a nonlinear characteristic with an increase in the depth;   modifying the initial value of the coefficient to a second value based on a shooting mode; and   converting the depth associated with the pixel within the image data to have the nonlinear characteristic with the increase in the depth, based on the initial value or the second value, the nonlinear characteristic being different between the plurality of shooting modes, and different shooting modes having different converted depths.   
     
     
         17 . The non-transitory computer-readable storage medium according to  claim 16 , wherein the modifying modifies the initial value of the coefficient to the second value that is smaller than the initial value, after setting the initial value of the coefficient and in response to the shooting mode being a first shooting mode. 
     
     
         18 . The non-transitory computer-readable storage medium according to  claim 16 , wherein the modifying modifies the initial value of the coefficient to the second value that is greater than the initial value, after setting the initial value of the coefficient and in response to the shooting mode being a second shooting mode. 
     
     
         19 . The non-transitory computer-readable storage medium according to  claim 16 , further comprising performing smoothing processing on the image data to a degree depending on the converted depth corresponding to the pixel in the image data based on a converted depth corresponding to a predetermined pixel in the image data. 
     
     
         20 . The non-transitory computer-readable storage medium according to  claim 19 , wherein
 the converting converts the depth associated with the pixel within the image data in accordance with the function to nonlinearly approach a predetermined value with the increase in the depth, the function being a function with a characteristic that varies depending on the coefficient, and   the performing performs the smoothing processing based on the depth converted in accordance with the characteristic.