Method, apparatus, and non-transitory computer-readable recording medium for streaming 3d objects

Abstract

The present disclosure provides a method for sending at least one 3D object from a server to a client, the method including: extracting color information, alpha information and geometry information from the 3D object on the server; simplifying the geometry information; and encoding a stream including the color information, the alpha information and the simplified geometry information and sending the encoded stream from the server to the client.

1 . A method for sending at least one 3D object from a server to a client, comprising:
 extracting color information, alpha information and geometry information from the 3D object on the server;   simplifying the geometry information; and   encoding a stream including the color information, the alpha information and the simplified geometry information and sending the encoded stream from the server to the client.   
     
     
         2 . The method according to  claim 1 , wherein the simplifying the geometry information is to convert a cloud of points extracted from the 3D object to information of vertices of triangles. 
     
     
         3 . The method according to  claim 1  or  2 , wherein the stream further includes at least one of metadata, sound data, and a command. 
     
     
         4 . The method according to  claim 1  or  2 , wherein the server receives a command from the client to redraw the 3D object on the server. 
     
     
         5 . The method according to  claim 1  or  2 , wherein when the server receives a command from the client to redraw the 3D object, the server redraws the 3D object on the server, extracts the color information, the alpha information and the geometry information from the redrawn 3D object, simplifies the geometry information, and encodes a stream including the color information, the alpha information and the simplified geometry information of the redrawn 3D object and sends the encoded stream from the server to the client. 
     
     
         6 . The method according to  claim 1  or  2 , the color information and the alpha information are obtained by an RGB camera and the geometry information is obtained by at least one depth camera. 
     
     
         7 . A method for reproducing a 3D object on a client, the 3D object being present on a server, the method comprising:
 receiving from the server, an encoded stream including color information, alpha information and geometry information of the 3D object;   decoding the encoded stream and extracting the color information, the alpha information and the geometry information from the decoded stream;   reproducing a shape of the 3D object based on the geometry information; and   projecting information on the reproduced shape of the 3D object to reconstruct the 3D object, the information resulting from combining the color information and the alpha information.   
     
     
         8 . The method according to  claim 7 , further including displaying the reconstructed 3D object on a display device. 
     
     
         9 . The method according to  claim 8 , wherein the display device is a smart glassy smart glasses, a smartphone, a cell phone, a tablet, a laptop computer, a head-mounted display, a headset, a slate PC, a gaming terminal or AR-device. 
     
     
         10 . A server comprising at least one processor and a memory, wherein
 the at least one processor executes instructions stored in the memory, to   extract color information, alpha information and geometry information from a 3D object on the server;   simplify the geometry information; and   encode a stream including the color information, the color information, the alpha information and the simplified geometry information and send the encoded stream from the server to a client.   
     
     
         11 . A client comprising at least one processor and a memory, wherein
 the at least one processor executes instructions stored in the memory, to   receive from a server, an encoded stream including color information, alpha information and geometry information of a 3D object;   decode the encoded stream and extract the color information, the alpha information and the geometry information from the decoded stream;   reproduce a shape of the 3D object based on the geometry information; and   project information on the reproduced shape of the 3D object to reconstruct the 3D object, the information resulting from combining the color information and the alpha information.   
     
     
         12 . A non-transitory computer-readable recording medium including a program stored therein, the program comprising instructions for a processor to execute the method according to any one of  claims 1 ,  2 ,  7 ,  8  and  9 .