Methods and apparatus of viewport adaptive 360 degree video delivery

Abstract

Systems, methods, and instrumentalities are disclosed for client centric service quality control. A first viewport of a 360 degree video may be determined. The 360 degree video may comprise one or more of an equirectangular, a cube-map, a cylindrical, a pyramidal, and/or a spherical projection mapping. The first viewport may be associated with a spatial region of the 360 degree video. An adjacent area that extends around the spatial region may be determined. A second viewport of the 360 degree video may be determined. A bitstream associated with the 360 degree video may be received. One or more enhanced regions may be included in the bitstream. The one or more enhanced regions may correspond to the first and/or second viewport. A high coding bitrate may be associated with the first viewport and/or the second viewport.

1 - 24 . (canceled) 
     
     
         25 . An apparatus comprising:
 a processor configured to:
 receive a media presentation description (MPD) file comprising a plurality of representations associated with a 360 degree video, the plurality of representations comprising a first representation and a second representation, wherein the first representation is associated with a first video layer for the 360 degree video at a first quality and wherein the second representation is associated with a second video layer for one or more spatial subsets of the 360 degree video at a second quality; 
 request the first video layer in the first representation based on the received MPD file; 
 identify a viewport of a user that is expected to be viewed; 
 request the second video layer that corresponds to a spatial subset of the 360 degree video in the second representation based on the identified viewport of the user and the received MPD file; and 
 render a current viewport of the user, the current viewport comprising the second video layer in the second representation overlaid onto the first video layer in the first representation, wherein the second quality has higher quality than the first quality. 
   
     
     
         26 . The apparatus of  claim 25 , wherein the first video layer is a full-frame video layer associated with the 360 degree video, and the second video layer is the one or more spatial subsets of the 360 degree video. 
     
     
         27 . The apparatus of  claim 25 , wherein the 360 degree video comprises a scalable 360 degree video. 
     
     
         28 . The apparatus of  claim 25 , wherein the first video layer is a scalable base layer associated with the 360 degree video, and the second video layer is a scalable enhancement layer associated with the 360 degree video. 
     
     
         29 . The apparatus of  claim 25 , wherein the second video layer is coded with one or more of a higher bitrate, a higher resolution, or a higher frame rate than the first video layer. 
     
     
         30 . The apparatus of  claim 25 , wherein the second video layer is coded independently from the first video layer. 
     
     
         31 . A method comprising:
 receiving a media presentation description (MPD) file comprising a plurality of representations associated with a 360 degree video, the plurality of representations comprising a first representation and a second representation, wherein the first representation is associated with a first video layer for the 360 degree video at a first quality and wherein the second representation is associated with a second video layer for one or more spatial subsets of the 360 degree video at a second quality;   requesting the first video layer in the first representation based on the received MPD file;   identifying a viewport of a user that is expected to be viewed;   requesting the second video layer that corresponds to a spatial subset of the 360 degree video in the second representation based on the identified viewport of the user and the received MPD file; and   rendering a current viewport of the user, the current viewport comprising the second video layer in the second representation at the second quality overlaid onto the first video layer in the first representation at the first quality, wherein the second quality has higher quality than the first quality.   
     
     
         32 . The method of  claim 31 , wherein the first video layer is a full-frame video layer associated with the 360 degree video, and the second video layer is the one or more spatial subsets of the 360 degree video. 
     
     
         33 . The method of  claim 31 , wherein the 360 degree video comprises a scalable 360 degree video. 
     
     
         34 . The method of  claim 31 , wherein the first video layer is a scalable base layer associated with the 360 degree video, and the second video layer is a scalable enhancement layer associated with the 360 degree video. 
     
     
         35 . The method of  claim 31 , wherein the second video layer is coded with one or more of a higher bitrate, a higher resolution, or a higher frame rate than the first video layer. 
     
     
         36 . The method of  claim 31 , wherein the second video layer is coded independently from the first video layer.