US2016255288A1PendingUtilityA1
A method to use array sensors to measure multiple types of data at full resolution of the sensor
Est. expiryOct 4, 2033(~7.2 yrs left)· nominal 20-yr term from priority
Inventors:Magued (Aka Fr. Gregory) Bishay
H04N 25/134H04N 23/58H04N 25/48H04N 23/45H04N 23/11H04N 25/42H10F 39/8053H10F 39/026H10F 39/8027H10F 39/802H04N 5/349H04N 5/332H04N 5/2258H04N 5/343H04N 25/131
51
PatentIndex Score
0
Cited by
0
References
0
Claims
Abstract
An actuator is configured to move a sensor array between first and second positions in order to provide color image data and other data with full resolution of the sensor array. In many embodiments, the output resolution of the sensor array for each type of data comprises twice the resolution of the sensor array without movement. The alternating movement of the sensor array between the first and second positions provides output images with decreased artifacts that might otherwise be present without the alternating movement of the sensor array.
Claims
exact text as granted — not AI-modifiedWhat is claimed is:
1 . An apparatus comprising:
(a) a sensor array comprising a plurality of Bayer patterns disposed on a first plurality of pairs of adjacent linear arrays to sense Bayer pattern data, a second plurality of pairs of adjacent linear arrays having different patterns located between the first plurality of pairs of adjacent linear arrays to sense a different type of data; (b) an actuator to move the sensor array from a first position to a second position, wherein physical positions of the first plurality of adjacent pairs of linear arrays alternate with physical positions of the second plurality of pairs of adjacent linear arrays; and (c) circuitry coupled to the actuator and the sensor array to output the Bayer pattern data and the different type of data from each of the first position and the second position.
2 . The apparatus in claim 1 , wherein each pixel of the Bayer pattern data is output associated with the first position or the second position and wherein each pixel of the different type of data is output associated with the first position or the second position.
3 . The apparatus in claim 1 , wherein the different pattern comprises one or more of an infrared filter pattern, an ultraviolet filter pattern, a non-Bayer visible light filter pattern, or a pattern comprising no filter.
4 . The apparatus in claim 1 , wherein each of the pairs of the first plurality of pairs of the adjacent linear arrays comprises two adjacent pairs and wherein each of the second plurality of pairs of adjacent linear arrays comprises two adjacent pairs of linear arrays.
5 . The apparatus in claim 1 , wherein each of the pairs of the first plurality of pairs of the adjacent linear arrays comprises three or more adjacent pairs of linear arrays and wherein each of the second plurality of pairs of adjacent linear arrays comprises three or more adjacent pairs of linear arrays.
6 . The apparatus in claim 1 further comprising a first limit switch to signal when the sensor array is located in the first position and a second limit switch to signal when the sensor array is located in the second position, wherein the circuitry is configured to integrate first composite data of the sensor array in the first position in response to the first limit switch sensing the sensor array moving into the first position and integrate second composite data of the sensor array in response to the second limit switch sensing the sensor moving into the second position.
7 . The apparatus in claim 1 , wherein circuitry is configured to generate the Bayer pattern data from the first composite data and the second composite data and to generate the different type of data from the first composite data and the second composite data.
8 . The apparatus in claim 1 , the circuitry comprising instructions to move the sensor array to the first position and measure first data of the sensor array in the first position and move the sensor array to the second position and measure second data of the sensor array in the second position, the processor further comprising instructions to provide a first full frame image from the first plurality of pairs of adjacent linear arrays having the Bayer pattern and to output a second full frame image from the second plurality of pairs of adjacent linear arrays having different pattern, wherein the sensor comprises a number of pixels and wherein each of the first full frame image and the second full frame image comprising the number of pixels of the sensor array.
9 . The apparatus in claim 1 , wherein the actuator comprises a micro-electrical mechanical system.
10 . The apparatus in claim 1 , wherein each of the plurality of Bayer patterns comprises a red pixel to sense red light, a blue pixel to sense blue light, and a pair of diagonal green pixels to sense green light.
11 . The apparatus in claim 1 further comprising digital data storage to store an output generated from the sensor arrays.
12 . The apparatus in claim 1 further comprising a digital signal processor to control one or more of the following: transferring the output to digital data storage, timing of the image acquisition, movement of the arrays, configuring the circuitry, configuring image formation, and generating images.
13 . A system, comprising:
(a) a sensor array operable to sense a first type of data and a second type of data, the first and second types of data being different; and (b) a micro-electrical mechanical system (MEMS) to move at least one of (1) the sensor array such that, at a common location, different sensors of the sensor array capture different ones of the first and second type of data and (2) a filter positioned over at least one of the sensors of the sensor array such that a selected sensor can capture first or second type of data depending on the position of the filter.
14 . The system of claim 13 , wherein, in a first operating mode, a first composite frame is captured by the sensor array and, in a second operating mode, a second composite frame is captured by the sensor array, wherein the first and second composite frames each comprise first and second types of data, wherein the first and second composite frames are divided into a first frame comprising only the first type of data and a second frame comprising only the second type of data, wherein the first and second frames are stored in different and discrete computer readable media, and wherein the first type of data is visible light and the second type of data is infrared light.
15 . The system of claim 13 , wherein, in a first operating mode, a first composite frame is captured by the sensor array and, in a second operating mode, a second composite frame is captured by the sensor array, wherein the first and second composite frames each comprise first and second types of data, wherein the first and second composite frames are divided into a first frame comprising only the first type of data and a second frame comprising only the second type of data, wherein the first and second frames are stored in different and nonoverlapping memory locations, and wherein the first type of data is one or more of blue, green and red light and the second type of data is infrared light.
16 . The system of claim 13 , wherein the sensor array comprises a first set of sensors to sense the first type of data and a second set of sensors to sense the second type of data, wherein the first set of sensors has different membership than the second set of sensors, and wherein the MEMS moves the sensor array from first to second positions to collect the first and second frames, respectively.
17 . The system of claim 16 , wherein first and second sets of sensors are interlaced with one another, wherein the interlacing is done on a row-by-row and/or column-by-column basis, and wherein a distance and direction of movement of the sensor array by the MEMS are a function of the type of interlacing employed.
18 . The system of claim 13 , wherein the MEMS moves the filter positioned over at least one of the sensors such that a selected sensor can capture first or second type of data depending on the position of the filter.
19 . The system of claim 18 ,wherein the first type of data is one or more of blue, green and red light and the second type of data is infrared light, wherein the filter blocks substantially (a) the one or more of blue, green and red light while passing infrared light or (b) infrared light while passing the one or more of the blue, green and red light, wherein, in a first operating mode, the MEMS positions the filter over the selected sensor to filter light before the light contacts the selected sensor and, in a second operating mode, the MEMS removes the filter from the selected sensor to enable unfiltered light to contact the selected sensor.
20 . The system of claim 18 , wherein the first type of data is one or more of the blue, green and red light and the second type of data is infrared light, wherein a first filter blocks substantially the one or more of the blue, green and red light while passing infrared light and a second filter blocks substantially infrared light while passing the one or more of the blue, green and red light, and wherein, in a first operating mode, the MEMS positions the first filter, but not the second filter, over the selected sensor to filter light before the light contacts the selected sensor and, in a second operating mode, the MEMS positions the second filter, but not the first filter, over the selected sensor to filter light before the light contacts the selected sensor.
21 . A method, comprising:
(a) over a first time interval, collecting, by a sensor array, a first and/or second types of data, the first and second types of data being different; (b) moving, by a micro-electrical mechanical system (MEMS), at least one of (1) the sensor array such that, at a common location, different sensors of the sensor array capture different ones of the first and second type of data and (2) a filter positioned over at least one of the sensors such that a selected sensor can capture first or second type of data depending on the position of the filter; and (c) over a second time interval, collecting, by the sensor array after movement by the MEMS, first and/or second types of data.
22 . The method of claim 21 , wherein, in a first operating mode, a first composite frame is captured by the sensor array and, in a second operating mode, a second composite frame is captured by the sensor array, wherein the first and second composite frames each comprise first and second types of data, wherein the first and second composite frames are divided into a first frame comprising only the first type of data and a second frame comprising only the second type of data, wherein the first and second frames are stored in different and discrete computer readable media, and wherein the first type of data is visible light and the second type of data is infrared light.
23 . The method of claim 21 , wherein, in a first operating mode, a first composite frame is captured by the sensor array and, in a second operating mode, a second composite frame is captured by the sensor array, wherein the first and second composite frames each comprise first and second types of data, wherein the first and second composite frames are divided into a first frame comprising only the first type of data and a second frame comprising only the second type of data, wherein the first and second frames are stored in different and nonoverlapping memory locations, and wherein the first type of data is one or more of blue, green and red light and the second type of data is infrared light.
24 . The method of claim 21 , wherein the sensor array comprises a first set of sensors to sense the first type of data and a second set of sensors to sense the second type of data, wherein the first set of sensors has different membership than the second set of sensors, and wherein the MEMS moves the sensor array from first to second positions to collect the first and second frames, respectively.
25 . The method of claim 24 , wherein first and second sets of sensors are interlaced with one another, wherein the interlacing is done on a row-by-row and/or column-by-column basis, and wherein a distance and direction of movement of the sensor array by the MEMS are a function of the type of interlacing employed.
26 . The method of claim 21 , wherein the MEMS moves the filter positioned over at least one of the sensors such that a selected sensor can capture first or second type of data depending on the position of the filter.
27 . The method of claim 26 , wherein the first type of data is one or more of blue, green and red light and the second type of data is infrared light, wherein the filter blocks substantially (a) the one or more of blue, green and red light while passing infrared light or (b) infrared light while passing the one or more of the blue, green and red light, wherein, in a first operating mode, the MEMS positions the filter over the selected sensor to filter light before the light contacts the selected sensor and, in a second operating mode, the MEMS removes the filter from the selected sensor to enable unfiltered light to contact the selected sensor.
28 . The method of claim 26 , wherein the first type of data is one or more of the blue, green and red light and the second type of data is infrared light, wherein a first filter blocks substantially the one or more of the blue, green and red light while passing infrared light and a second filter blocks substantially infrared light while passing the one or more of the blue, green and red light, and wherein, in a first operating mode, the MEMS positions the first filter, but not the second filter, over the selected sensor to filter light before the light contacts the selected sensor and, in a second operating mode, the MEMS positions the second filter, but not the first filter, over the selected sensor to filter light before the light contacts the selected sensor.
29 . A tangible and non-transient computer readable medium comprising microprocessor executable instructions operable, when executed by the microprocessor, to perform at least the following steps:
(a) over a first time interval, collecting, by a sensor array, a first and/or second types of data, the first and second types of data being different; (b) moving, by a micro-electrical mechanical system (MEMS), at least one of (1) the sensor array such that, at a common location, different sensors of the sensor array capture different ones of the first and second type of data and (2) a filter positioned over at least one of the sensors such that a selected sensor can capture first or second type of data depending on the position of the filter; and (c) over a second time interval, collecting, by the sensor array after movement by the MEMS, first and/or second types of data.
30 . The computer readable medium of claim 29 , wherein, in a first operating mode, a first composite frame is captured by the sensor array and, in a second operating mode, a second composite frame is captured by the sensor array, wherein the first and second composite frames each comprise first and second types of data, wherein the first and second composite frames are divided into a first frame comprising only the first type of data and a second frame comprising only the second type of data, wherein the first and second frames are stored in different and discrete computer readable media, and wherein the first type of data is visible light and the second type of data is infrared light.
31 . The computer readable medium of claim 29 , wherein, in a first operating mode, a first composite frame is captured by the sensor array and, in a second operating mode, a second composite frame is captured by the sensor array, wherein the first and second composite frames each comprise first and second types of data, wherein the first and second composite frames are divided into a first frame comprising only the first type of data and a second frame comprising only the second type of data, wherein the first and second frames are stored in different and nonoverlapping memory locations, and wherein the first type of data is one or more of blue, green and red light and the second type of data is infrared light.
32 . The computer readable medium of claim 29 , wherein the sensor array comprises a first set of sensors to sense the first type of data and a second set of sensors to sense the second type of data, wherein the first set of sensors has different membership than the second set of sensors, and wherein the MEMS moves the sensor array from first to second positions to collect the first and second frames, respectively.
33 . The computer readable medium of claim 32 , wherein first and second sets of sensors are interlaced with one another, wherein the interlacing is done on a row-by-row and/or column-by-column basis, and wherein a distance and direction of movement of the sensor array by the MEMS are a function of the type of interlacing employed.
34 . The computer readable medium of claim 29 , wherein the MEMS moves the filter positioned over at least one of the sensors such that a selected sensor can capture first or second type of data depending on the position of the filter.
35 . The computer readable medium of claim 34 , wherein the first type of data is one or more of blue, green and red light and the second type of data is infrared light, wherein the filter blocks substantially (a) the one or more of blue, green and red light while passing infrared light or (b) infrared light while passing the one or more of the blue, green and red light, wherein, in a first operating mode, the MEMS positions the filter over the selected sensor to filter light before the light contacts the selected sensor and, in a second operating mode, the MEMS removes the filter from the selected sensor to enable unfiltered light to contact the selected sensor.
36 . The computer readable medium of claim 34 , wherein the first type of data is one or more of the blue, green and red light and the second type of data is infrared light, wherein a first filter blocks substantially the one or more of the blue, green and red light while passing infrared light and a second filter blocks substantially infrared light while passing the one or more of the blue, green and red light, and wherein, in a first operating mode, the MEMS positions the first filter, but not the second filter, over the selected sensor to filter light before the light contacts the selected sensor and, in a second operating mode, the MEMS positions the second filter, but not the first filter, over the selected sensor to filter light before the light contacts the selected sensor.Join the waitlist — get patent alerts
Track US2016255288A1 — get alerts on status changes and closely related new filings.
We store only your email — no account needed. See our privacy policy.