Systems, methods, and media for reconstructing a space-time volume from a coded image

Abstract

Systems, methods, and media for reconstructing a space-time volume from a coded image are provided. In accordance with some embodiments, systems for reconstructing a space-time volume from a coded image are provided, the systems comprising: an image sensor that outputs image data; and at least one processor that: causes a projection of the space-time volume to be captured in a single image of the image data in accordance with a coded shutter function; receives the image data; and performs a reconstruction process on the image data to provide a space-time volume corresponding to the image data.

What is claimed is: 
     
         1 . A system for reconstructing a space-time volume from a coded image, comprising:
 an image sensor that outputs image data; and   at least one processor that:
 causes a projection of the space-time volume to be captured in a single image of the image data in accordance with a coded shutter function; 
 receives the image data; and 
 performs a reconstruction process on the image data to provide a space-time volume corresponding to the image data. 
   
     
     
         2 . The system of  claim 1 , wherein the reconstruction process is based on an over-complete dictionary. 
     
     
         3 . The system of  claim 2 , wherein the over-complete dictionary is based on rotated video samples. 
     
     
         4 . The system of  claim 1 , wherein the coded shutter function has random start times for pixel exposure bumps. 
     
     
         5 . The system of  claim 1 , wherein the coded shutter function has only a single exposure period per pixel per sensor integration time. 
     
     
         6 . The system of  claim 1 , wherein the coded shutter function has at least one pixel in each pixel neighborhood exposed during each interval of a sensor integration time. 
     
     
         7 . The system of  claim 1 , further comprising a Liquid Crystal on Silicon chip that modulates light onto the image sensor according to the coded shutter function in response to signals from the at least one processor. 
     
     
         8 . The system of  claim 1 , wherein the image sensor has pixels that individually addressable. 
     
     
         9 . The system of  claim 1 , wherein the reconstruction process includes performing an orthogonal matching pursuit algorithm. 
     
     
         10 . A method for reconstructing a space-time volume from a coded image, comprising:
 causing a projection of the space-time volume to be captured by an image sensor in a single image of image data in accordance with a coded shutter function using a hardware processor;   receiving the image data using a hardware processor; and   performing a reconstruction process on the image data to provide a space-time volume corresponding to the image data using a hardware processor.   
     
     
         11 . The method of  claim 10 , wherein the reconstruction process is based on an over-complete dictionary. 
     
     
         12 . The method of  claim 11 , wherein the over-complete dictionary is based on rotated video samples. 
     
     
         13 . The method of  claim 10 , wherein the coded shutter function has random start times for pixel exposure bumps. 
     
     
         14 . The method of  claim 10 , wherein the coded shutter function has only a single exposure period per pixel per sensor integration time. 
     
     
         15 . The method of  claim 10 , wherein the coded shutter function has at least one pixel in each pixel neighborhood exposed during each interval of a sensor integration time. 
     
     
         16 . The method of  claim 10 , further comprising modulating light onto the image sensor using an Liquid Crystal on Silicon chip according to the coded shutter function in response to signals from the hardware processor. 
     
     
         17 . The method of  claim 10 , wherein the image sensor has pixels that are individually addressable. 
     
     
         18 . The method of  claim 10 , wherein the reconstruction process includes performing an orthogonal matching pursuit algorithm. 
     
     
         19 . A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processor, cause the processor to perform a method for reconstructing a space-time volume from a coded image, the method comprising:
 causing a projection of the space-time volume to be captured in a single image of image data in accordance with a coded shutter function;   receiving the image data; and   performing a reconstruction process on the image data to provide a space-time volume corresponding to the image data.   
     
     
         20 . The non-transitory computer-readable medium of  claim 19 , wherein the reconstruction process is based on an over-complete dictionary. 
     
     
         21 . The non-transitory computer-readable medium of  claim 20 , wherein the over-complete dictionary is based on rotated video samples. 
     
     
         22 . The non-transitory computer-readable medium of  claim 19 , wherein the coded shutter function has random start times for pixel exposure bumps. 
     
     
         23 . The non-transitory computer-readable medium of  claim 19 , wherein the coded shutter function has only a single exposure period per pixel per sensor integration time. 
     
     
         24 . The non-transitory computer-readable medium of  claim 19 , wherein the coded shutter function has at least one pixel in each pixel neighborhood exposed during each interval of a sensor integration time. 
     
     
         25 . The non-transitory computer-readable medium of  claim 19 , wherein the method further comprises modulating light onto the image sensor according to the coded shutter function. 
     
     
         26 . The non-transitory computer-readable medium of  claim 19 , wherein the method further comprises individually addressing pixels of an image sensor. 
     
     
         27 . The non-transitory computer-readable medium of  claim 19 , wherein the reconstruction process includes performing an orthogonal matching pursuit algorithm.