Dynamic adjustment of cloud game data streams to output device and network quality

Abstract

Aspects of the present disclosure relate to systems and methods for the dynamic adjustment of data streamed over a network which is then displayed on an output device. In particular, aspects of the present disclosure relate to systems and methods for determining the display capabilities of an output device and then formatting two or more streams of data configured for display on the output device, wherein the user interface and video data are contained in separate streams, such that the content is displayed in a manner consistent with the display capabilities of the output device. The output can then be adjusted or prioritized based on device orientation and network quality.

What is claimed is: 
     
         1 . A non-transitory computer readable medium having processor-executable instructions embodied therein, wherein execution of the instructions by a processor causes the processor to implement a method, the method comprising:
 a) determining the display capabilities of an output device;   b) formatting two or more data streams configured for display on the output device such that the content is displayed in a manner consistent with the display capabilities of the output device, wherein the two or more data streams include a data stream for user interface data and a separate data stream for video data; and   c) delivering the two or more streams of content data to the output device.   
     
     
         2 . The non-transitory computer readable medium of  claim 1 , wherein the two or more data streams include a data stream containing compressed data. 
     
     
         3 . The non-transitory computer readable medium of  claim 1 , wherein the two or more streams of content include a data stream containing data to be displayed as text. 
     
     
         4 . The non-transitory computer readable medium of  claim 1 , wherein the two or more streams of content include a data stream containing data to be displayed as a heads-up-display (HUD). 
     
     
         5 . The non-transitory computer readable medium of  claim 1 , wherein the two or more data streams include a data stream containing data to be displayed as inventory information. 
     
     
         6 . The non-transitory computer readable medium of  claim 1 , wherein the two or more data include a data stream containing data to be displayed map information. 
     
     
         7 . The non-transitory computer readable medium of  claim 1 , wherein the display of one data stream is prioritized over the display of another. 
     
     
         8 . The non-transitory computer readable medium of  claim 7 , wherein the prioritization of display is determined by the quality of the network connection. 
     
     
         9 . The non-transitory computer readable medium of  claim 1 , wherein the display instructions are delivered by a server to a client device platform used in combination with the output device. 
     
     
         10 . The non-transitory computer readable medium of  claim 9 , wherein the client device platform is a gaming console. 
     
     
         11 . The non-transitory computer readable medium of  claim 9 , wherein the client device platform is a computer. 
     
     
         12 . The non-transitory computer readable medium of  claim 9 , wherein the client device platform is a cellular phone. 
     
     
         13 . The non-transitory computer readable medium of  claim 9 , wherein the client device platform is a tablet. 
     
     
         14 . The non-transitory computer readable medium of  claim 9 , wherein the client device platform is a hand-held computing device. 
     
     
         15 . The non-transitory computer readable medium of  claim 9 , wherein the client device platform is a set top box. 
     
     
         16 . The non-transitory computer readable medium of  claim 9 , wherein the client device platform is a telephonic system. 
     
     
         17 . The non-transitory computer readable medium of  claim 9 , wherein the client device platform is a dongle device. 
     
     
         18 . The non-transitory computer readable medium of  claim 9 , wherein the client device is configured to query the output device to determine the display capabilities of the output device and deliver this information to the server. 
     
     
         19 . The non-transitory computer readable medium of  claim 1 , wherein the display capability information also includes a picture orientation of the output device. 
     
     
         20 . The non-transitory computer readable medium of  claim 1 , wherein the content data includes a video portion of a video game. 
     
     
         21 . The non-transitory computer readable medium of  claim 1 , wherein the content data is a stream of a computer program session running on a remote machine. 
     
     
         22 . The non-transitory computer readable medium of  claim 1 , wherein the output device is a television. 
     
     
         23 . The non-transitory computer readable medium of  claim 1 , wherein the output device is a projector. 
     
     
         24 . The non-transitory computer readable medium of  claim 1 , wherein the output device and the client device platform are the same device. 
     
     
         25 . The non-transitory computer readable medium of  claim 1 , wherein b) includes formatting the video data with an application used to generate video frames for the data stream for video data. 
     
     
         26 . The non-transitory computer readable medium of  claim 1 , wherein the two or more streams include a game stream and a user interface stream. 
     
     
         27 . The non-transitory computer readable medium of  claim 26 , wherein the two or more streams include a game stream, a user interface stream and one or more additional streams. 
     
     
         28 . The non-transitory computer readable medium of  claim 26 , wherein the two or more streams include a game stream, a user interface stream and a video chat stream between a first client device and a second client device. 
     
     
         29 . The non-transitory computer readable medium of  claim 26 , wherein the two or more streams include a game stream, a user interface stream and a video chat stream between a first client device and a second client device, wherein the method further comprises coordinating a peer-to-peer session between the first and second client devices to let the first and second client devices combine the video chat stream with the game stream and the user interface stream. 
     
     
         30 . On a server configured to operate on a network, a method, comprising:
 a) determining the display capabilities of an output device;   b) formatting two or more data streams configured for display on the output device such that the content is displayed in a manner consistent with the display capabilities of the output device, wherein the two or more data streams include a data stream for user interface data and a separate data stream for video data.   
     
     
         31 . A system comprising:
 a processor, and   a memory coupled to the processor;   
       wherein the processor is configured to perform a method, the method comprising: 
       a) determining the display capabilities of an output device; 
       b) formatting two or more data streams configured for display on the output device such that the content is displayed in a manner consistent with the display capabilities of the output device, wherein the two or more data streams include a data stream for user interface data and a separate data stream for video data; and 
       c) delivering the two or more streams of content data to the output device.