See-Through Near-Eye Light Field Display

Abstract

A see-through near-eye light field display device, the device comprising a light field camera device and a light field display device arranged back-to-back, the light field camera device configured to capture an input light field video stream, the light field display device configured to display an output light field video stream based on the input light field video stream.

1 . A see-through near-eye light field display system, the system comprising a near-eye light field display device and a light field camera device arranged back-to-back, the light field camera device configured to capture an input light field video stream, the light field display device configured to display an output light field video stream based on the input light field video stream. 
     
     
         2 . The system of  claim 1 , wherein the light field camera device comprises at least one input focus modulator, whereby the focus of at least part of the input light field video stream is modulated according to a fixation depth of a viewer of the light field display device. 
     
     
         3 . The system of  claim 1 , wherein the light field display device comprises at least one output focus modulator, whereby the focus of at least part of the output light field video stream is modulated according to a fixation depth of a viewer of the light field display device. 
     
     
         4 . The system of  claim 1 , wherein the light field camera device comprises at least one input focus modulator and the light field display device comprises at least one output focus modulator, whereby the focus of at least part of the input light field video stream and the focus of at least part of the output light field video stream are modulated, respectively, according to a fixation depth of a viewer of the light field display device. 
     
     
         5 . The system of  claim 1 , wherein the input light field video stream is resampled to translate its light field boundary to compensate for the separation of the light field camera device and the light field display device, to produce the output light field video stream. 
     
     
         6 . The system of  claim 1 , wherein the input light field video stream is incorporated into a rendered light field video stream to produce the output light field video stream, the rendered light field video stream comprising at least one virtual 3D object. 
     
     
         7 . The system of  claim 6 , wherein the rendered light field video stream comprises at least one virtual 3D object which interacts with part of the input light field video stream, the interaction selected from the group comprising: reflection and refraction. 
     
     
         8 . The system of  claim 1 , wherein the light field camera device comprises an array of light field camera elements, each camera element comprising:
 (a) an array of radiance sensors for sensing the radiance of a set of input beams over time, the input beams spanning a two-dimensional angular field; and   (b) an input focus modulator for modulating the focus of the input beams over time.   
     
     
         9 . The system of  claim 1 , wherein the light field camera device comprises an array of light field camera elements, each camera element comprising:
 (a) a scanner for scanning an input beam across a two-dimensional angular field;   (b) an input focus modulator for modulating the focus of the input beam over time; and   (c) a radiance sensor for sensing the radiance of the input beam over time.   
     
     
         10 . The system of  claim 1 , wherein the light field display device comprises an array of light field display elements, each display element comprising:
 (a) an array of beam generators and radiance modulators for generating and modulating the radiance of a set of output beams over time, the output beams spanning a two-dimensional angular field; and   (b) an output focus modulator for modulating the focus of the output beams over time.   
     
     
         11 . The system of  claim 1 , wherein the light field display device comprises an array of light field display elements, each display element comprising:
 (a) a beam generator for generating an output beam of light;   (b) a radiance modulator for modulating the radiance of the output beam over time;   (c) an output focus modulator for modulating the focus of the output beam over time; and   (d) a scanner for scanning the output beam across a two-dimensional angular field.   
     
     
         12 . A see-through near-eye light field display system, the system comprising a first near-eye two-way light field camera and display device and a second two-way light field camera and display device, the two devices arranged back-to-back, each device configured to capture an input light field video stream and to display an output light field video stream based on the input light field video stream from the other device. 
     
     
         13 . The system of  claim 12 , wherein at least one of the two-way devices comprises at least one input focus modulator, whereby the focus of at least part of its input light field video stream is modulated according to a fixation depth of a viewer of the other two-way device. 
     
     
         14 . The system of  claim 12 , wherein at least one of the two-way devices comprises at least one output focus modulator, whereby the focus of at least part of its output light field video stream is modulated according to a fixation depth of a viewer of the two-way device. 
     
     
         15 . The system of  claim 12 , wherein at least one of the two-way devices comprises at least one input focus modulator and the other two-way device comprises at least one output focus modulator, whereby the focus of at least part of its input light field video stream and the focus of at least part of the output light field video stream of the other device are modulated, respectively, according to a fixation depth of a viewer of the other two-way device. 
     
     
         16 . The system of  claim 12 , wherein at least one of the input light field video streams is resampled to translate its light field boundary to compensate for the separation of the two-way devices, to produce the corresponding output light field video stream. 
     
     
         17 . The system of  claim 12 , wherein at least one of the input light field video streams is incorporated into a rendered light field video stream to produce the corresponding output light field video stream, the rendered light field video stream comprising at least one virtual 3D object. 
     
     
         18 . The system of  claim 17 , wherein the rendered light field video stream comprises at least one virtual 3D object which interacts with part of the corresponding input light field video stream, the interaction selected from the group comprising: reflection and refraction. 
     
     
         19 . The system of  claim 12 , wherein at least one of the two-way devices comprises an array of two-way camera and display elements, each two-way element comprising:
 (a) an array of radiance sensors for sensing the radiance of a corresponding set of input beams over time, the input beams spanning a two-dimensional angular field;   (b) an input focus modulator for modulating the focus of the input beams over time;   (c) an array of beam generators and radiance modulators for generating and modulating the radiance of a set of output beams over time, the output beams spanning a two-dimensional angular field; and   (d) an output focus modulator for modulating the focus of the output beams over time.   
     
     
         20 . The system of  claim 12 , wherein at least one of the two-way devices comprises an array of two-way camera and display elements, each two-way element comprising:
 (a) a scanner for scanning an input beam and an output beam across a two-dimensional angular field;   (b) an input focus modulator for modulating the focus of the input beam over time;   (c) a radiance sensor for sensing the radiance of the input beam over time;   (d) a beam generator for generating the output beam of light;   (e) a radiance modulator for modulating the radiance of the output beam over time; and   (f) an output focus modulator for modulating the focus of the output beam over time.