Selective culling of multi-dimensional data sets

Abstract

Method and system for selective culling of multi-dimensional data sets. Selective culling system introduces a feedback control method for remote users (e.g., client-side) to customize the selection, transmission, and display of datasets (e.g., on server-side) or any collection or subset of datasets.

1 .- 2 . (canceled) 
     
     
         3 . An immersive display system, comprising:
 a display, in communication with one or more processors; and   a plurality of sensor modules, in communication with the one or more processors,   wherein the one or more processors are configured to:
 receive data obtained by the plurality of sensors modules to determine a control command; 
 selectively cull one or more subsets of a plurality of data sets according to the control command; and 
 transmit the one or more subsets to the display. 
   
     
     
         4 . The immersive display system of  claim 3 , wherein the one or more processors are configured to determine the control command further based at least on one or more information about the immersive display system selected from the group consisting of display type, display resolution, display size, display frame rate, and distance from a viewer to the display. 
     
     
         5 . The immersive display system of  claim 3 , wherein the plurality of data sets comprise video and audio content. 
     
     
         6 . The immersive display system of  claim 3 , wherein the one or more processors is configured to determine a field of interest of a viewer of the display based at least on the data obtained by the plurality of sensor modules, wherein the control command is determined based at least in part on the field of interest. 
     
     
         7 . The immersive display system of  claim 3 , wherein the plurality of sensor modules are configured to track body movement, head movement, and eye movement of a viewer of the display. 
     
     
         8 . The immersive display system of  claim 7 , wherein the plurality of sensor modules are configured to track stereo view information for each eye of the viewer. 
     
     
         9 . The immersive display system of  claim 3 , wherein the immersive display system is a head-mounted display (HMD). 
     
     
         10 . The immersive display system of  claim 3 , wherein an amount of culling is configured to be proportional to an available or desired bandwidth between a server system and the processor. 
     
     
         11 . A computer-implemented method for selectively culling data sets at data source for a viewer of a display system, comprising:
 (a) determining a control command based at least on requested data sets, field of interest of the viewer, and available bandwidth;   (b) receiving, at a server, the control command, wherein the control command comprises encoding of instructions on which one or more subsets among the data sets are to be culled;   (c) selectively culling, at the server, one or more subsets among the requested data sets according to the transmitted control command; and   (d) serving, to the display system, the selectively culled data set.   
     
     
         12 . The method of  claim 11 , wherein the requested data sets comprise video and audio content. 
     
     
         13 . The method of  claim 11 , wherein the requested data sets comprise sensor data. 
     
     
         14 . The method of  claim 11 , wherein the control command is further based at least on display system information, wherein the display system information includes display type, display resolution, display size, display frame rate, and distance from the user to the display system. 
     
     
         15 . The method of  claim 14 , wherein the control command is further based at least on metatags and metadata embedded or associated with the requested data sets. 
     
     
         16 . The method of  claim 11 , wherein a size of the control command is 128 bytes or less. 
     
     
         17 . The method of  claim 12 , wherein the video and audio content comprises two-dimensional, three-dimensional, or virtual reality video and audio content. 
     
     
         18 . The method of  claim 17 , wherein the control command information is further based at least on foveal area and foveal area target shape. 
     
     
         19 . The method of  claim 11 , wherein the field of interest information is further adjusted based on user input methods. 
     
     
         20 . The method of  claim 11 , wherein the one or more subsets that are within the viewer's field of interest are selectively culled. 
     
     
         21 . The method of  claim 11 , wherein the field of interest of the viewer is obtained by monitoring one or more sensors local to the viewer. 
     
     
         22 . The system of  claim 21 , wherein the one or more sensors are configured to track body movement, head movement, eye movement of the viewer.