Sliced encoding and decoding for remote rendering

Abstract

Disclosed herein are related to a device and a method of remotely rendering an image. In one approach, a device divides an image of an artificial reality space into a plurality of slices. In one approach, the device encodes a first slice of the plurality of slices. In one approach, the device encodes a portion of a second slice of the plurality of slices, while the device encodes a portion of the first slice. In one approach, the device transmits the encoded first slice of the plurality of slices to a head wearable display. In one approach, the device transmits the encoded second slice of the plurality of slices to the head wearable display, while the device transmits a portion of the encoded first slice to the head wearable display.

What is claimed is: 
     
         1 . A first device comprising:
 at least one processor configured to:
 encode a first slice of a plurality of slices of an artificial reality image, starting at a first time and completing at a second time, 
 encode a second slice of the plurality of slices starting at a third time and completing at a fourth time, wherein the third time is after the first time and before the second time; 
 transmit, via a transmitter, the encoded first slice to a second device starting at a fifth time after the second time, and completing at the sixth time; and 
 transmit, via the transmitter, the encoded second slice to the second device starting at a seventh time that is after the fifth time and before the sixth time. 
   
     
     
         2 . The first device of  claim 1 , wherein:
 a content generator comprising the at least one processor is configured to encode the first slice and the second slice; and   a communication interface coupled to the content generator is configured to transmit the encoded first slice and the encoded second slice.   
     
     
         3 . The first device of  claim 1 , wherein the at least one processor is further configured to: 
 partition an image of an artificial reality space into the plurality of slices; and   transmit the encoded first slice and the encoded second slice to a head wearable display.   
     
     
         4 . The first device of  claim 1 , wherein:
 the first slice and the second slice are separated by a boundary; and   the at least one processor is further configured to generate motion vectors of the artificial reality image, wherein the motion vectors do not traverse the boundary between the first slice and the second slice.   
     
     
         5 . The first device of  claim 1 , wherein the at least one processor is configured to transmit a portion of the encoded first slice, while the at least one processor encodes a portion of the second slice. 
     
     
         6 . The first device of  claim 1 , wherein the at least one processor is configured to:
 encode a third slice, starting at a ninth time and completing at a tenth time, wherein the ninth time is before the second time; and   transmit the encoded third slice starting at an eleventh time before the sixth time.   
     
     
         7 . The first device of  claim 6 , wherein the at least one processor is configured to transmit a portion of the encoded second slice, while encoding a portion of the third slice. 
     
     
         8 . The device of  claim 1 , wherein the at least one processor is further configured to:
 receive sensor measurements indicating a location or an orientation of a head wearable display; and   generate a space of the artificial reality image according to the location or the orientation of the head wearable display.   
     
     
         9 . A method comprising:
 encoding, by a device, a first slice of a plurality of slices of an artificial reality image, starting at a first time and completing at a second time,   encoding, by the device a second slice of the plurality of slices starting at a third time and completing at a fourth time, wherein the third time is after the first time and before the second time;   transmitting, by the device, the encoded first slice to a second device starting at a fifth time after the second time, and completing at the sixth time; and   transmitting, by the device, the encoded second slice to the second device starting at a seventh time that is after the fifth time and before the sixth time.   
     
     
         10 . The method of  claim 9 , further comprising:
 partitioning, by the device, an image of an artificial reality space into the plurality of slices; and   transmitting, by the device, the encoded first slice and the encoded second slice to a head wearable display.   
     
     
         11 . The method of  claim 9 , further comprising:
 generating, by the device, motion vectors of the artificial reality image, wherein the motion vectors do not traverse a boundary between the first slice and the second slice separating the first slice and the second slice.   
     
     
         12 . The method of  claim 9 , further comprising:
 transmitting, by the device, a portion of the encoded first slice, while the at least one processor encodes a portion of the second slice.   
     
     
         13 . The method of  claim 9 , further comprising:
 encoding, by the device, a third slice, starting at a ninth time and completing at a tenth time, wherein the ninth time is before the second time; and   transmitting, by the device, the encoded third slice starting at an eleventh time before the sixth time.   
     
     
         14 . The method of  claim 13 , further comprising:
 transmitting, by the device, a portion of the encoded second slice, while encoding a portion of the third slice.   
     
     
         15 . The method of  claim 9 , further comprising:
 receiving, by the device, sensor measurements indicating a location or an orientation of a head wearable display; and   generating, by the sensor device, a space of the artificial reality image according to the location or the orientation of the head wearable display.   
     
     
         16 . A non-transitory computer readable medium storing program instructions for causing at least one processor of a device to:
 encode a first slice of a plurality of slices of an artificial reality image, starting at a first time and completing at a second time,   encode a second slice of the plurality of slices starting at a third time and completing at a fourth time, wherein the third time is after the first time and before the second time;   transmit, via a transmitter, the encoded first slice to a second device starting at a fifth time after the second time, and completing at the sixth time; and   transmit, via the transmitter, the encoded second slice to the second device starting at a seventh time that is after the fifth time and before the sixth time.   
     
     
         17 . The non-transitory computer readable medium of  claim 15 , wherein the program instructions cause the at least one processor to:
 partition an image of an artificial reality space into the plurality of slices; and   transmit the encoded first slice and the encoded second slice to a head wearable display.   
     
     
         18 . The non-transitory computer readable medium of  claim 15 , wherein the program instructions cause the at least one processor to:
 separate the first slice and the second slice by a boundary; and   generate motion vectors of the artificial reality image, wherein the motion vectors do not traverse the boundary between the first slice and the second slice.   
     
     
         19 . The non-transitory computer readable medium of  claim 15 , wherein the program instructions cause the at least one processor to:
 encode a third slice, starting at a ninth time and completing at a tenth time, wherein the ninth time is before the second time; and   transmit the encoded third slice starting at an eleventh time before the sixth time.   
     
     
         20 . The non-transitory computer readable medium of  claim 15 , wherein the program instructions cause the at least one processor to:
 receive sensor measurements indicating a location or an orientation of a head wearable display; and   generate a space of the artificial reality image according to the location or the orientation of the head wearable display.