Optimizing delay-sensitive network-based communications with latency guidance

Abstract

Devices, computer-readable media, and methods for selecting a type of transmission for an immersive visual stream based upon a latency estimate. For instance, a processing system including at least one processor may obtain a latency estimate for an immersive visual stream, determine whether the latency estimate exceeds a latency threshold for selecting a type of transmission for the immersive visual stream, and select the type of transmission for the immersive visual stream from among a field of view restricted type of transmission and a field of view plus out of scene type of transmission based upon the determining. When the latency estimate is determined to not exceed the latency threshold, the field of view restricted type of transmission is selected. When the latency estimate is determined to exceed the latency threshold, the field of view plus out of scene type of transmission is selected.

What is claimed is: 
     
         1 . A method comprising:
 obtaining, by a processing system including at least one processor, a latency estimate for a network-based communication;   determining, by the processing system, whether the latency estimate exceeds a latency threshold for selecting a type of packet loss protection for the network-based communication; and   selecting, by the processing system, the type of packet loss protection for the network-based communication from among: a first type of packet loss protection and a second type of packet loss protection, based upon the determining, wherein when the latency estimate is determined to not exceed the latency threshold, the first type of packet loss protection is selected, and wherein when the latency estimate is determined to exceed the latency threshold, the second type of packet loss protection is selected.   
     
     
         2 . The method of  claim 1 , wherein the first type of packet loss protection includes a packet retransmission scheme. 
     
     
         3 . The method of  claim 2 , wherein the second type of packet loss protection comprises an error correcting code. 
     
     
         4 . The method of  claim 3 , wherein the error correcting code comprises a forward error correction scheme. 
     
     
         5 . The method of  claim 2 , wherein the second type of packet loss protection comprises an automatic repeat request scheme. 
     
     
         6 . The method of  claim 2 , wherein the second type of packet loss protection comprises a hybrid automatic repeat request scheme. 
     
     
         7 . The method of  claim 2 , wherein the second type of packet loss protection comprises a redundant stream scheme. 
     
     
         8 . The method of  claim 1 , further comprising:
 sending an instruction to apply to the network-based communication the type of packet loss protection that is selected.   
     
     
         9 . The method of  claim 1 , further comprising:
 applying to the network-based communication the type of packet loss protection that is selected.   
     
     
         10 . The method of  claim 1 , wherein the network-based communication comprises data for rendering at least one of:
 three-dimensional visual content;   virtual reality content;   augmented reality content; or   volumetric video content.   
     
     
         11 . The method of  claim 1 , wherein the network-based communication comprises data for at least one of: visual data or audio data. 
     
     
         12 . The method of  claim 11 , wherein the visual data comprises at least one of: a video call or a video gaming streaming. 
     
     
         13 . The method of  claim 11 , wherein the audio data comprises at least one of: a voice call, or a conference call. 
     
     
         14 . The method of  claim 1 , wherein the network-based communication comprises at least one of: an information feed for stock trading, an information feed for providing premises security, or an information feed for machine learning data processing. 
     
     
         15 . The method of  claim 1 , wherein the processing system comprises at least one of:
 a recipient device of the network-based communication; or   a transmitting device of the network-based communication.   
     
     
         16 . The method of  claim 1 , wherein the processing system comprises a network-based processing system. 
     
     
         17 . A device comprising:
 a processor; and   a computer-readable medium storing instructions which, when executed by the processor, cause the processor to perform operations, the operations comprising:
 obtaining a latency estimate for a network-based communication; 
 determining whether the latency estimate exceeds a latency threshold for selecting a type of packet loss protection for the network-based communication; and 
 selecting the type of packet loss protection for the network-based communication from among: a first type of packet loss protection and a second type of packet loss protection, based upon the determining, wherein when the latency estimate is determined to not exceed the latency threshold, the first type of packet loss protection is selected, and wherein when the latency estimate is determined to exceed the latency threshold, the second type of packet loss protection is selected. 
   
     
     
         18 . A non-transitory computer-readable medium storing instructions which, when executed by a processing system including at least one processor, cause the processing system to perform operations, the operations comprising:
 obtaining a latency estimate for a network-based communication;   determining whether the latency estimate exceeds a latency threshold for selecting a type of packet loss protection for the network-based communication; and   selecting the type of packet loss protection for the network-based communication from among: a first type of packet loss protection and a second type of packet loss protection, based upon the determining, wherein when the latency estimate is determined to not exceed the latency threshold, the first type of packet loss protection is selected, and wherein when the latency estimate is determined to exceed the latency threshold, the second type of packet loss protection is selected.   
     
     
         19 . The non-transitory computer-readable medium of  claim 18 , wherein the first type of packet loss protection includes a packet retransmission scheme. 
     
     
         20 . The non-transitory computer-readable medium of  claim 19 , wherein the second type of packet loss protection comprises an error correcting code.