Encapsulation and decapsulation methods and apparatuses for point cloud media file, and storage medium

Abstract

This application provides encapsulation and decapsulation methods and apparatuses for a point cloud media file, and a storage medium. The methods comprises acquiring a target point cloud and encoding the target point cloud to obtain a bitstream, the target point cloud comprising at least one type of attribute information, each type of attribution information comprising M attribute instances of instance data, and M being a positive integer greater than 1; and encapsulating the bitstream of the target point cloud according to first feature information of at least one attribute instance of M attribute instances to obtain a media file, the media file comprising the first feature information of the at least one attribute instance.

What is claimed is: 
     
         1 . An encapsulation method for a point cloud media file, applied to a file encapsulation device, the method comprising:
 acquiring a target point cloud and encoding the target point cloud to obtain a bitstream, the target point cloud comprising at least one type of attribute information, each type of attribution information comprising M attribute instances of instance data, and M being a positive integer greater than 1; and   encapsulating the bitstream of the target point cloud according to first feature information of at least one attribute instance of M attribute instances to obtain a media file, the media file comprising the first feature information of the at least one attribute instance.   
     
     
         2 . The method according to  claim 1 , wherein the first feature information of the attribute instance comprises: at least one of an identification of the attribute instance, a priority of the attribute instance, and a type of the attribute instance. 
     
     
         3 . The method according to  claim 2 , wherein the type of the attribute instance comprises at least one of an attribute instance associated with a recommendation viewport and an attribute instance associated with user feedback. 
     
     
         4 . The method according to  claim 3 , wherein when the type of the attribute instance is the attribute instance associated with the recommendation viewport, the method further comprises:
 adding second feature information of the attribute instance to metadata of the recommendation viewport associated with the attribute instance.   
     
     
         5 . The method according to  claim 4 , wherein the second feature information of the attribute instance comprises at least one of an identification of the attribute instance and an attribute type of the attribute instance. 
     
     
         6 . The method according to  claim 1 , wherein encapsulating the bitstream of the target point cloud according to first feature information of at least one attribute instance of M attribute instances to obtain an media file comprises:
 adding the first feature information of the at least one attribute instance to a sub-sample information box corresponding to the M attribute instances, when geometry information and attribute information of a frame of point cloud in the target point cloud are encapsulated in a track or an item; or   adding the first feature information of the at least one attribute instance to a component information box corresponding to the M attribute instances, when each attribute instance of the M attribute instances is encapsulated in a track or an item; or   adding the first feature information of the at least one attribute instance to a track group box or an entity group box, when each attribute instance of the M attribute instances is encapsulated in a track or an item, and M tracks corresponding to the M attribute instances constitute the track group, or M items corresponding to the M attribute instances constitute the entity group.   
     
     
         7 . The method according to  claim 1 , further comprising:
 linking tracks of the M attribute instances by a track group box, when the M attribute instances are encapsulated in the tracks of the M attribute instances on a one-to-one basis; or   linking items of the M attribute instances by an entity group box, when the M attribute instances are encapsulated in the items of the M attribute instances on a one-to-one basis.   
     
     
         8 . The method according to  claim 1 , further comprising:
 transmitting first information to a file decapsulation device, the first information indicating the first feature information of the at least one attribute instance of the M attribute instances.   
     
     
         9 . The method according to  claim 8 , further comprising:
 receiving first request information transmitted by the file decapsulation device, the first request information requesting a media file of a target attribute instance; and   transmitting the media file of the target attribute instance to the file decapsulation device according to the first request information.   
     
     
         10 . The method according to  claim 8 , further comprising:
 receiving second request information transmitted by the file decapsulation device, the second request information requesting a media file of a target point cloud; and   transmitting the media file of the target point cloud to the file decapsulation device according to the second request information.   
     
     
         11 . A decapsulation method for a point cloud media file, applied to a file decapsulation device, the method comprising:
 receiving first information transmitted by a file encapsulation device, the first information indicating first feature information of at least one attribute instance of M attribute instances in a target point cloud, and M being a positive integer greater than 1; and   determining a target attribute instance from the at least one attribute instance using the first feature information, and acquiring instance data corresponding to the target attribute instance.   
     
     
         12 . The method according to  claim 11 , wherein the first feature information of the attribute instance comprises: at least one of an identification of the attribute instance, a priority of the attribute instance, and a type of the attribute instance. 
     
     
         13 . The method according to  claim 12 , wherein the type of the attribute instance comprises at least one of an attribute instance associated with a recommendation viewport and an attribute instance associated with user feedback. 
     
     
         14 . The method according to  claim 13 , wherein second feature information of the attribute instance is added to metadata of the recommendation viewport associated with the attribute instance, when the type of the attribute instance is the attribute instance associated with the recommendation viewport. 
     
     
         15 . The method according to  claim 11 , wherein the acquiring instance data corresponding to the target attribute instance comprises:
 transmitting first request information to the file encapsulation device, the first request information requesting a media file of the target attribute instance;   receiving the media file corresponding to the target attribute instance transmitted by the file encapsulation device; and   decapsulating the media file and then decoding same to obtain the instance data of the target attribute instance.   
     
     
         16 . The method according to  claim 11 , further comprising:
 transmitting second request information to the file encapsulation device according to the first information, the second request information requesting a media file of the target point cloud;   receiving the media file of the target point cloud transmitted by the file encapsulation device;   acquiring a media file of the target attribute instance from the media file of the target point cloud; and   decapsulating the media file of the target attribute instance and then decoding same to obtain the instance data of the target attribute instance.   
     
     
         17 . The method according to  claim 15 , wherein when first feature information of an attribute instance comprises a type of the attribute instance, determining the target attribute instance according to the first feature information of at least one attribute instance comprises:
 determining the target attribute instance from the at least one attribute instance according to the first feature information of the at least one attribute instance of M pieces of attribute information, when the type of the attribute instance is an attribute instance associated with user feedback; or   acquiring a metadata of a recommendation viewport, when the type of the attribute instance is an attribute instance associated with the recommendation viewport, and determining the target attribute instance from the at least one attribute instance of the M pieces of attribute information according to second feature information of an attribute instance comprised in the metadata of the recommendation viewport.   
     
     
         18 . The method according to  claim 14 , wherein the second feature information of the attribute instance comprises at least one of an identification of the attribute instance and an attribute type of the attribute instance. 
     
     
         19 . The method according to  claim 11 , wherein
 the first feature information of the attribute instance is added to a sub-sample information box corresponding to the M attribute instances, when geometry information and attribute information of a frame of point cloud in the target point cloud are encapsulated in a track or an item; or   the first feature information of the attribute instance is added to a component information box corresponding to the M attribute instances, when each attribute instance of the M attribute instances is encapsulated in a track or an item; or   the first feature information of the attribute instance is added to a track group box or an entity group box, when each attribute instance of the M attribute instances is encapsulated in a track or an item, and M tracks corresponding to the M attribute instances constitute the track group, or M items corresponding to the M attribute instances constitute the entity group.   
     
     
         20 . A non-transitory computer-readable storage medium, configured to store a computer program for causing a computer to perform an encapsulation method for a point cloud media file, executed by one or more processors, the method comprising:
 acquiring a target point cloud and encoding the target point cloud to obtain a bitstream, the target point cloud comprising at least one type of attribute information, each type of attribution information comprising M attribute instances of instance data, and M being a positive integer greater than 1; and   encapsulating the bitstream of the target point cloud according to first feature information of at least one attribute instance of M attribute instances to obtain a media file, the media file comprising the first feature information of the at least one attribute instance.