Video communication including holographic content

Abstract

A video communication system uses a light field display to present a holographic image of a remote scene (e.g., a hologram of a remote participant). The system may include a local light field display assembly and a controller. The controller generates display instructions based on visual data corresponding to a remote scene received from a remote image capture system (e.g., a remote light field display system). The display instructions cause the local light field display assembly to generate a holographic image of the remote scene.

1 .- 39 . (canceled) 
     
     
         40 . A light field display system in a local physical space, the light field display system comprising:
 a controller configured to generate display instructions based on visual data corresponding to a remote scene, the visual data received from a remote image capture system located in a remote physical space; and   a local light field display assembly located within a local physical space that includes a local participant, the light field assembly operable to simultaneously capture image data corresponding to local physical space and project holographic content generated from the display instructions, the holographic content including a holographic video of the remote scene,   wherein the controller is further configured to send, to a remote image display system in the remote physical space, outgoing visual data derived from the captured image data;   wherein the remote image display system is operable to generate video content including the local participant based on the outgoing visual data.   
     
     
         41 . The light field display system of  claim 40 , wherein the local light field display assembly comprises a plurality of light field display modules. 
     
     
         42 . The light field display system of  claim 41  wherein the plurality of light field display modules are tiled to form a seamless display surface. 
     
     
         43 . The light field display system of  claim 40 , wherein the remote image capture system is a remote light field display system operable to simultaneously capture light field image data corresponding to the remote scene and project the video content including the local participant. 
     
     
         44 . The light field display system of  claim 40 , wherein the holographic content further includes a holographic prop. 
     
     
         45 . The light field display system of  claim 44 , wherein the holographic prop is a holographic image generated from a 3D model of an object. 
     
     
         46 . The light field display system of  claim 44 , further comprising a tracking system configured to generate tracking data representing motion of the local participant, wherein the holographic prop is manipulated based on the tracking data. 
     
     
         47 . The light field display system of  claim 40 , wherein the holographic content further includes a holographic whiteboard, wherein content on the holographic whiteboard is synchronized with a corresponding holographic whiteboard generated by a remote light field display assembly. 
     
     
         48 . The light field display system of  claim 40 , wherein the display instructions are operable to further cause the local light field display assembly to emit energy to create a tactile surface. 
     
     
         49 . The light field display system of  claim 48 , wherein the tactile surface is collocated with at least a portion of a holographic image. 
     
     
         50 . The light field display system of  claim 49 , wherein the holographic image is a holographic image of a remote participant or a holographic prop. 
     
     
         51 . The light field display system of  claim 40 , further comprising a mobile light field system located in the local physical space. 
     
     
         52 . The light field display system of  claim 51 , wherein a remote participant located in the remote physical space controls motion of the mobile light field system within the local physical space. 
     
     
         53 . The light field display system of  claim 52 , wherein the mobile light field system is configured to capture image data corresponding to an area near the mobile light field system and provide the captured image data to the remote image display system. 
     
     
         54 . The light field display system of  claim 51 , wherein the mobile light field system includes a bidirectional surface configured to simultaneously capture light field image data and project holographic content. 
     
     
         55 . The light field display system of  claim 54 , wherein image data captured by the mobile light field system is projected as holographic content to a remote participant. 
     
     
         56 . The light field display system of  claim 55 , wherein a hologram of at least a portion of the remote participant is projected in the local physical space simultaneously with the holographic content being projected to the remote participant. 
     
     
         57 . The light field display system of  claim 40 , wherein the holographic content includes a holographic image of a remote participant in the remote physical location and one or more holographic images of one or more additional remote participants located in one or more additional remote physical locations. 
     
     
         58 . The light field display system of  claim 40 , wherein the visual data is vectorized and the light field display system further comprises a processing engine configured to convert the vectorized visual data into rasterized visual data, the display instructions being generated from the rasterized visual data. 
     
     
         59 . The light field display system of  claim 40 , wherein the light field display system further comprises a local decoding block that matches a remote encoding block used to compress the visual data, the local decoding block configured to decompress the visual data. 
     
     
         60 . The light field display system of  claim 59 , wherein the captured image data includes visual data corresponding to the local participant and the light field display system further comprises:
 a local encoding block configured to compress the visual data corresponding to the local participant; and   a network interface configured to send the compressed visual data corresponding to the local participant to the remote image display system.   
     
     
         61 . The light field display system of  claim 40 , wherein the controller is further configured to receive additional visual data that corresponds to a prerecorded holographic video and generate additional display instruction, the additional display instructions causing the local light field display assembly to generate the prerecorded holographic video responsive to user input provided by the local participant. 
     
     
         62 . The light field display system of  claim 61 , wherein the light field display system further comprises controls configured to enable the local participant to change a perspective from which the prerecorded holographic video is viewed.