Telematics and environmental data of live events in an extended reality environment

Abstract

Techniques are described herein for delivering telematic and environmental data of live events to provide immersive experiences. In one aspect, the techniques include receiving a multimedia data stream of a live event at an encoder comprising one or more codecs from one or more user devices. The multimedia data stream is compressed via the one or more codecs to generate a compressed multimedia data stream. Upon receiving a request from a playback device, the compressed multimedia data stream is transmitted to a decoder comprising the one or more codecs to serve the playback device.

What is claimed is: 
     
       1. One or more non-transitory computer-readable media storing computer-executable instructions that upon execution cause one or more processors to perform acts comprising:
 receiving, at an encoder comprising one or more codecs, a multimedia data stream of a live event from one or more user devices, the one or more user devices including a user device that broadcasts a presence of the user device as a non-playback device on a network to discover one or more extended reality (XR)-enabled playback devices connected to the network that are configured to provide an immersive experience to a user based at least on the multimedia data stream; 
 compressing the multimedia data stream to generate a compressed multimedia data stream; 
 receiving a request from an XR-enabled playback device of the one or more XR-enabled playback devices, the request comprising a device identifier associated with the XR-enabled playback device; and 
 transmitting the compressed multimedia data stream to a decoder comprising the one or more codecs. 
 
     
     
       2. The one or more non-transitory computer-readable media of  claim 1 , wherein the acts further comprise:
 receiving an additional multimedia data stream of the live event from the one or more user devices; 
 combining the multimedia data stream and the additional multimedia data stream of the live event to generate a combined multimedia data stream in a predetermined file format; 
 compressing the combined multimedia data stream to generate a combined compressed multimedia data stream; 
 receiving an additional request from the XR-enabled playback device; and 
 transmitting the combined compressed multimedia data stream to the decoder comprising the one or more codecs. 
 
     
     
       3. The one or more non-transitory computer-readable media of  claim 1 , wherein the request from the XR-enabled playback device further comprises a compatible file format, and wherein the acts further comprise:
 decompressing the compressed multimedia data stream to generate a decompressed multimedia data stream of the compatible file format for playback on the XR-enable playback device with the device identifier. 
 
     
     
       4. The one or more non-transitory computer-readable media of  claim 1 , wherein the multimedia data stream comprises at least one of video data, audio data, spatial data, telematics data, and sensor data. 
     
     
       5. The one or more non-transitory computer-readable media of  claim 1 , wherein the one or more user devices are configured to capture physical world data comprising at least one of telematics data, gyroscopic data, and six degrees of freedom (six-dof) data. 
     
     
       6. The one or more non-transitory computer-readable media of  claim 1 , and wherein the acts further comprise:
 determining a compatible file format for the XR-enabled playback device via a database that stores device settings for the XR-enabled playback device; and 
 decompressing the compressed multimedia data stream to generate a decompressed multimedia data stream of the compatible file format for playback on the XR-enable playback device with the device identifier. 
 
     
     
       7. The one or more non-transitory computer-readable media of  claim 1 , wherein the device identifier is associated with a device group identifier, the device group identifier associated with one or more destination devices paired with the XR-enabled playback device, wherein the acts further comprise:
 delivering the multimedia data stream to individual destination devices based at least on device capabilities of the individual destination devices. 
 
     
     
       8. A computer-implemented method, comprising:
 receiving, at an encoder comprising one or more codecs, a multimedia data stream of a live event from one or more user devices, the one or more user devices including a user device that broadcasts a presence of the user device as a non-playback device on a network to discover one or more extended reality (XR)-enabled playback devices connected to the network that are configured to provide an immersive experience to a user based at least on the multimedia data stream; 
 compressing the multimedia data stream to generate a compressed multimedia data stream; 
 receiving a request from an XR-enabled playback device of the one or more XR-enabled playback devices, the request comprising a device identifier associated with the XR-enabled playback device; and 
 transmitting the compressed multimedia data stream to a decoder comprising the one or more codecs. 
 
     
     
       9. The computer-implemented method of  claim 8 , further comprising:
 receiving an additional multimedia data stream of the live event from the one or more user devices; 
 combining the multimedia data stream and the additional multimedia data stream of the live event to generate a combined multimedia data stream in a predetermined file format; 
 compressing the combined multimedia data stream to generate a combined compressed multimedia data stream; 
 receiving an additional request from the XR-enabled playback device; and 
 transmitting the combined compressed multimedia data stream to the decoder comprising the one or more codecs. 
 
     
     
       10. The computer-implemented method of  claim 8 , wherein the request from the XR-enabled playback device further comprises a compatible file format, further comprising:
 decompressing the compressed multimedia data stream to generate a decompressed multimedia data stream of the compatible file format for playback on the XR-enabled playback device with the device identifier. 
 
     
     
       11. The computer-implemented method of  claim 10 , wherein the multimedia data stream comprises at least one of video data, audio data, spatial data, telematics data, and sensor data. 
     
     
       12. The computer-implemented method of  claim 10 , wherein the one or more user devices are configured to capture physical world data comprising at least one of telematics data, gyroscopic data, and six degrees of freedom (six-dof) data. 
     
     
       13. The computer-implemented method of  claim 10 , wherein the XR-enabled playback device is associated with a user profile and a user account. 
     
     
       14. The computer-implemented method of  claim 8 , wherein the multimedia data stream is processed via a first codec of the one or more codecs and the compressed multimedia data stream is processed via a second codec of the one or more codecs. 
     
     
       15. A system, comprising:
 one or more non-transitory storage mediums configured to provide stored computer-readable instructions, the one or more non-transitory storage mediums coupled to one or more processors, the one or more processors configured to execute the computer-readable instructions to cause the one or more processors to:
 receive, at an encoder comprising one or more codecs, a multimedia data stream of a live event from one or more user devices, the one or more user devices including a user device that broadcasts a presence of the user device as a non-playback device on a network to discover one or more extended reality (XR)-enabled playback devices connected to the network that are configured to provide an immersive experience to a user based at least on the multimedia data stream; 
 compress the multimedia data stream to generate a compressed multimedia data stream; 
 receive a request from an XR-enabled playback device of the one or more XR-enabled playback devices, the request comprising a device identifier associated with the playback device; and 
 transmit the compressed multimedia data stream to a decoder comprising the one or more codecs. 
 
 
     
     
       16. The system of  claim 15 , wherein the one or more processors are further configured to:
 receive an additional multimedia data stream of the live event from the one or more user devices; 
 compress the additional multimedia data stream to generate an additional compressed multimedia data stream; 
 combine the compressed multimedia data stream and the additional compressed multimedia data stream of the live event to generate a combined compressed multimedia data stream; 
 receive an additional request from the XR-enabled playback device; and 
 transmit the combined compressed multimedia data stream to the decoder comprising the one or more codecs. 
 
     
     
       17. The system of  claim 15 , wherein the request from the XR-enabled playback device further comprises a compatible file format, and wherein the one or more processors are further configured to:
 decompress the compressed multimedia data stream to generate a decompressed multimedia data stream of the compatible file format for playback on the XR-enabled playback device with the device identifier. 
 
     
     
       18. The system of  claim 15 , wherein the multimedia data stream comprises at least one of video data, audio data, spatial data, telematics data, and sensor data. 
     
     
       19. The system of  claim 15 , wherein the one or more user devices are configured to capture physical world data comprising at least one of telematics data, gyroscopic data, and six degrees of freedom (six-dof) data. 
     
     
       20. The system of  claim 15 , wherein the device identifier is associated with a device group identifier, the device group identifier associated with one or more destination devices paired with the XR-enabled playback device, wherein the one or more processors are further configured to:
 deliver the multimedia data stream to individual destination devices based at least on device capabilities of the individual destination devices.