Multispectrum, multi-polarization (msmp) filtering for improved perception of difficult to perceive colors

Abstract

In one embodiment, a method includes accessing first image data generated by a first image sensor having a first filter array that has a first filter pattern. The first filter pattern includes a first filter type corresponding to a spectrum of interest and a second filter type. The method also includes accessing second image data generated by a second image sensor having a second filter array that has a second filter pattern different from the first filter pattern. The second filter pattern includes a number of second filter types, the number of second filter types and the number of first filter types have at least one filter type in common. The method also includes determining a correspondence between one or more first pixels of the first image data and one or more second pixels of the second image data.

1 . A method comprising, by a computing system:
 accessing image data captured by an image sensor of an optical camera, the optical camera having a filter array including a filter pattern, wherein the filter pattern comprises at least one filter type having a color of interest;   analyzing a portion of the image data based at least in part on the color of interest, wherein the portion of the image data comprises one or more objects associated with the color of interest;   determining a shape of the one or more objects associated with the color of interest based at least in part on a color value associated with the color of interest; and   classifying the one or more objects based on the determined shape of the one or more objects.   
     
     
         2 . The method of  claim 1 , wherein the filter array includes one or more filters responsive to light within a visible spectrum. 
     
     
         3 . The method of  claim 1 , wherein the image sensor includes at least one photosite corresponding to a wavelength range associated with the color of interest. 
     
     
         4 . The method of  claim 1 , wherein analyzing the portion of the image data based at least in part on the color of interest comprises analyzing the portion of the image data without utilizing an image signal processor (ISP). 
     
     
         5 . The method of  claim 1 , wherein determining the shape of the one or more objects is based at least in part on whether the color value is greater than a predetermined color threshold value. 
     
     
         6 . The method of  claim 5 , wherein the color value comprises an intensity of one or more photosites of the image sensor. 
     
     
         7 . The method of  claim 1 , further comprising:
 in response to classifying the one or more objects based on the determined shape, analyzing an additional portion of the image data based at least in part on the classification of the one or more objects, wherein the additional portion of the image data comprises one or more other objects surrounding the one or more objects.   
     
     
         8 . A system comprising:
 one or more non-transitory computer-readable storage media including instructions; and   one or more processors coupled to the one or more non-transitory computer-readable storage media, the one or more processors configured to execute the instructions to:
 access image data captured by an image sensor of an optical camera, the optical camera having a filter array including a filter pattern, wherein the filter pattern comprises at least one filter type having a color of interest; 
 analyze a portion of the image data based at least in part on the color of interest, wherein the portion of the image data comprises one or more objects associated with the color of interest; 
 determine a shape of the one or more objects associated with the color of interest based at least in part on a color value associated with the color of interest; and 
 classify the one or more objects based on the determined shape of the one or more objects. 
   
     
     
         9 . The system of  claim 8 , wherein the filter array includes one or more filters responsive to light within a visible spectrum. 
     
     
         10 . The system of  claim 8 , wherein the image sensor includes at least one photosite corresponding to a wavelength range associated with the color of interest. 
     
     
         11 . The system of  claim 8 , wherein the portion of the image data is analyzed without utilizing an image signal processor (ISP). 
     
     
         12 . The system of  claim 8 , wherein the shape of the one or more objects is determined based at least in part on whether the color value is greater than a predetermined color threshold value. 
     
     
         13 . The system of  claim 12 , wherein the color value comprises an intensity of one or more photosites of the image sensor. 
     
     
         14 . The system of  claim 8 , wherein the one or more non-transitory computer-readable storage media further comprises instructions that when executed by the one or more processors are configured to:
 in response to classifying the one or more objects based on the determined shape, analyze an additional portion of the image data based at least in part on the classification of the one or more objects, wherein the additional portion of the image data comprises one or more other objects surrounding the one or more objects.   
     
     
         15 . A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of a computing system, are configured to cause the one or more processors to:
 access image data captured by an image sensor of an optical camera, the optical camera having a filter array including a filter pattern, wherein the filter pattern comprises at least one filter type having a color of interest;   analyze a portion of the image data based at least in part on the color of interest, wherein the portion of the image data comprises one or more objects associated with the color of interest;   determine a shape of the one or more objects associated with the color of interest based at least in part on a color value associated with the color of interest; and   classify the one or more objects based on the determined shape of the one or more objects.   
     
     
         16 . The non-transitory computer-readable medium of  claim 15 , wherein the filter array includes one or more filters responsive to light within a visible spectrum. 
     
     
         17 . The non-transitory computer-readable medium of  claim 15 , wherein the image sensor includes at least one photosite corresponding to a wavelength range associated with the color of interest. 
     
     
         18 . The non-transitory computer-readable medium of  claim 15 , wherein the shape of the one or more objects is determined based at least in part on whether the color value is greater than a predetermined color threshold value. 
     
     
         19 . The non-transitory computer-readable medium of  claim 18 , wherein the color value comprises an intensity of one or more photosites of the image sensor. 
     
     
         20 . The non-transitory computer-readable medium of  claim 15 , wherein the instructions are further configured to cause the one or more processors to:
 in response to classifying the one or more objects based on the determined shape, analyze an additional portion of the image data based at least in part on the classification of the one or more objects, wherein the additional portion of the image data comprises one or more other objects surrounding the one or more objects.