Image method of image sensor, imaging apparatus and electronic device

Abstract

The present disclosure discloses an image forming method of image sensor, an image forming device and an electronic equipment. The image sensor includes a pixel array and a microlens array disposed on the pixel array, each four-adjacent-pixels of the pixel array includes one red pixel, one green pixel, one blue pixel, and one infrared pixel, the microlens array includes a plurality of microlenses and each microlens covers one pixel of the pixel array. The image forming method includes obtaining an output signal of each pixel of the pixel array, performing interpolation on the output signal of each pixel to obtain a red component, a green component, a blue component and an infrared component of each pixel, obtaining a type of current shooting scene, determining tricolor output values of each pixel according to the type of current shooting scene to generating an image according to the tricolor output values.

What is claimed is: 
     
         1 . An image forming method of an image sensor, wherein: the image sensor comprises a pixel array and a microlens array disposed on the pixel array, each adjacent four pixels of the pixel array comprises one red pixel, one green pixel, one blue pixel, and one infrared pixel, the microlens array comprises a plurality of microlenses and each microlens correspondingly covers each pixel of the pixel array, the image forming method comprising:
 obtaining an output signal of each pixel of the pixel array;   performing interpolation on the output signal of each pixel to obtain a red component, a green component, a blue component and an infrared component of each pixel;   obtaining a type of current shooting scene;   determining tricolor output values of each pixel according to the type of current shooting scene and   generating an image according to the tricolor output values.   
     
     
         2 . The image forming method according to  claim 1 , wherein the step of obtaining a type of current shooting scene comprises:
 obtaining an exposure time of the pixel array;   determining whether the exposure time is larger than or equal to a preset exposure-time threshold;   determining that the current shooting scene is a dark scene when the exposure time is larger than or equal to a preset exposure-time threshold; and   determining that the current shooting scene is a non-dark scene when the exposure time is less than the preset exposure-time threshold.   
     
     
         3 . The image forming method according to  claim 2 , wherein the step of determining tricolor output values of each pixel according to the type of current shooting scene comprises:
 determining the tricolor output values of each pixel according to the red component, the green component, the blue component and the infrared component of each pixel when the current shooting scene is the dark scene; and   determining the tricolor output values of each pixel according to the red component, the green component and the blue component of each pixel when the current shooting scene is the non-dark scene.   
     
     
         4 . The image forming method according to  claim 3 , wherein when the current shooting scene is the non-dark scene, the tricolor output values of each pixel are determined according to a formula as follow:
   R′=R, G′=G, B′=B,
   wherein R′, G′ and B′ represent the tricolor output values of one pixel, R represents the red component of the one pixel, G represents the green component of the one pixel and B represents the blue component of the one pixel.   
     
     
         5 . The image forming method according to  claim 3 , wherein when the current shooting scene is the dark scene, the tricolor output values of each pixel are determined according to an equation formula R′=R+ir, G′=G+ir, B′=B+ir, wherein R′, G′ and B′ represent the tricolor output values of one pixel, R represents the red component of the one pixel, G represents the green component of the one pixel, B represents the blue component of the one pixel and it represents the infrared component of the one pixel. 
     
     
         6 . The image forming method according to  claim 2 , wherein the step of generating an image according to the tricolor output values comprises:
 generating a color image according to the tricolor output values of each pixel when the current shooting scene is the non-dark scene; and   generating a black-and-white image according to the tricolor output values of each pixel when the current shooting scene is the dark scene.   
     
     
         7 . The image forming method according to  claim 1 , wherein
 each pixel of the pixel array includes a filter and a photosensitive device covered by the filter, wherein,   a red filter and the photosensitive device covered by the red filter constitute the red pixel, a green filter and the photosensitive device covered by the green filter constitute the green pixel, a blue filter and the photosensitive device covered by the blue filter constitute the blue pixel and the infrared filter and the photosensitive device covered by the infrared filter constitute the infrared pixel.   
     
     
         8 . The image forming method according to  claim 1 , wherein the microlenses respectively corresponding to the red pixel, the green pixel and the blue pixel only allow a transmission of visible light, the microlenses corresponding to the infrared pixel only allow a transmission of near-infrared light. 
     
     
         9 . The image forming method according to  claim 1 , wherein a
 interpolation method of performing interpolation on the output signal of each pixel is one of nearest neighbor interpolation, bilinear interpolation and edges-adaptive interpolation.   
     
     
         10 . An image forming device, comprising:
 an image sensor comprising a pixel array and a microlens array disposed on the pixel array, wherein:   each adjacent-four-pixels of the pixel array comprises one red pixel, one green pixel, one blue pixel, and one infrared pixel;   the microlens array comprises a plurality of microlenses and each microlens correspondingly covers each pixel of the pixel array; and   an image processing module connected with the image sensor, wherein the image processing module is configured to obtaining an output signal of each pixel of the pixel array, to perform interpolation on the output signal of each pixel to obtain a red component, a green component, a blue component and an infrared component of each pixel, and to obtain a type of current shooting scene and the image processing module is also configured to determine an tricolor output values of each pixel according to the type of current shooting scene and configured to generate an image according to the tricolor output values.   
     
     
         11 . The image forming device according to  claim 10 , wherein the image processing module is configured to obtain an exposure time of the pixel array and to determine whether the exposure time is larger than or equal to a preset exposure-time threshold, the image processing module determines the current shooting scene is a dark scene when the exposure time is greater than or equal to a preset exposure-time threshold, the image processing module determines the current shooting scene is a non-dark scene when the exposure time is less than the preset exposure-time threshold. 
     
     
         12 . The image forming device according to  claim 11 , wherein the image processing module is configured to determine the tricolor output values of each pixel according to the red component, the green component, the blue component and the infrared component of each pixel when the current shooting scene is the dark scene, and the image processing module is configured to determine the tricolor output values of each pixel according to the red component, the green component and the blue component of each pixel when the current shooting scene is the non-dark scene. 
     
     
         13 . The image forming device according to  claim 12 , wherein when the current shooting scene is the non-dark scene, the image processing module calculates tricolor output values of each pixel according to a formula R′=R, G′=G, B′=B, wherein R′, G′ and B′ represent the tricolor output values of one pixel, R represents the red component of the one pixel, G represents the green component of the one pixel and B represents the blue component of the one pixel. 
     
     
         14 . The image forming device according to  claim 12 , wherein when the current shooting scene is the dark scene, the image processing module calculates tricolor output values of each pixel according to an equation formula R′=R+ir, G′=G+ir, B′=B+ir, wherein R′, G′ and B′ represent the tricolor output values of one pixel, R represents the red component of to the one pixel, G represents the green component of the one pixel, B represents the blue component of the one pixel and it represents the infrared component of the one pixel. 
     
     
         15 . The image forming device according to  claim 11 , wherein the image processing module is configured to generate a color image according to the tricolor output values of each pixel, when the current shooting scene is the non-dark scene, and is configured to generate a black-and-white image according to the tricolor output values of each pixel when the current shooting scene is the dark scene. 
     
     
         16 . The image forming device according to  claim 10 , wherein each pixel of the pixel array comprises a filter and a photosensitive device covered by the filter, wherein:
 a red filter and the photosensitive device covered by the red filter constitute the red pixel, a green filter and the photosensitive device covered by the green filter constitute the green pixel, a blue filter and the photosensitive device covered by the blue filter constitute the blue pixel and the infrared filter and the photosensitive device covered by the infrared filter constitute the infrared pixel.   
     
     
         17 . The image forming device according to  claim 10 , wherein the microlenses in correspondence to the red pixel, the green pixel and the blue pixel only allow the transmission of visible light, the microlenses in correspondence to the infrared pixel only allow the transmission of near-infrared light. 
     
     
         18 . The image forming device according to  claim 10 , wherein the image processing module performs interpolation on the output signal of each pixel, and the interpolation method is one of nearest neighbor interpolation, bilinear interpolation and edges-adaptive interpolation. 
     
     
         19 . An electronic equipment comprises the image forming device according to  claim 10   
     
     
         20 . The electronic equipment according to  claim 19 , wherein the electronic equipment comprises a monitoring equipment.