Display Layout Optimization of Multiple Media Streams

Abstract

A system and method for optimizing a display layout of multiple video streams at a sink device is provided. The display layout of multiple streams may be dynamically optimized based on a number of different variables, including characteristics of the sink device, total number of active incoming streams, active audio, and other characteristics of the source material or device. The source of an incoming media stream may contain useful characteristics for optimizing the display layout of multiple media streams. One such characteristic of a source device may include the device type, such as laptop, PC, phone, or tablet. Information may be extracted from each incoming stream in order to predict a source device type from which the incoming media stream originates.

What is claimed is: 
     
         1 . A media receiver comprising:
 a memory configured to store machine-readable instructions; and   a processor circuitry in communication with the memory, wherein the processor circuitry is configured to execute the machine-readable instructions to cause the processing circuitry to:
 receive a first media stream corresponding to a first media source; 
 obtain first metadata from the first media stream; 
 receive a second media stream corresponding to a second media source; 
 obtain second metadata from the second media stream; 
 determine a first source device type for the first media source based on a reference to the first metadata; 
 determine a second source device type for the second media source based on a reference to the second metadata; and 
 control a display layout of the first media stream and the second media stream for display on a sink device based on at least the first source type and the second source type. 
   
     
     
         2 . The media receiver of  claim 1 , wherein the processor circuitry is configured to execute the machine-readable instructions to further cause the processing circuitry to:
 receive attribute data corresponding to the sink device; and   further control the display layout including the first media stream and the second media stream based additionally on the attribute data corresponding to the sink device.   
     
     
         3 . The media receiver of  claim 2 , wherein the attribute data corresponding to the sink device includes a predetermined user viewing distance of the sink device. 
     
     
         4 . The media receiver of  claim 1 , wherein the first metadata includes MAC address classification corresponding to the first media source and the second metadata further includes MAC address classification corresponding to the second media source; and
 wherein the processor circuitry is configured to execute the machine-readable instructions to cause the processing circuitry to:
 determine the first source device type for the first media source based on at least the MAC address classification corresponding to the first media source; and 
 determine the second source device type for the second media source based on at least the MAC address classification corresponding to the second media source. 
   
     
     
         5 . The media receiver of  claim 1 , wherein the first metadata includes Hostname classification corresponding to the first media source and the second metadata further includes Hostname address classification corresponding to the second media source; and
 wherein the processor circuitry is configured to execute the machine-readable instructions to cause the processing circuitry to:
 determine the first source device type for the first media source based on at least the Hostname classification corresponding to the first media source; and 
 determine the second source device type for the second media source based on at least the Hostname classification corresponding to the second media source. 
   
     
     
         6 . The media receiver of  claim 1 , wherein the first metadata includes protocol, aspect ratio, and resolution information of the first media source and the second metadata further includes protocol, aspect ratio, and resolution information of the second media source; and
 wherein the processor circuitry is configured to execute the machine-readable instructions to cause the processing circuitry to:
 determine the first source device type for the first media source based on at least one of the protocol, aspect ratio, or resolution information of the first media source; and 
 determine the second source device type for the second media source based on at least one of the protocol, aspect ratio, or resolution information of the second media source. 
   
     
     
         7 . The media receiver of  claim 1 , wherein the first metadata includes computer vision object detection and computer vision image classification information of the first media source and the second metadata further includes computer vision object detection and computer vision image classification information of the second media source; and
 wherein the processor circuitry is configured to execute the machine-readable instructions to cause the processing circuitry to:
 determine the first source device type for the first media source based on at least one of the computer vision object detection or computer vision image classification information of the first media source; and 
 determine the second source device type for the second media source based on at least one of the computer vision object detection or computer vision image classification information of the second media source. 
   
     
     
         8 . The media receiver of  claim 1 , wherein the processor circuitry is configured to execute the machine-readable instructions to cause the processing circuitry to control the display layout to include:
 a first display window including a display of the first media stream; and   a second display window including a display of the second media stream, wherein the first display window is sized differently from the second display window.   
     
     
         9 . The media receiver of  claim 1 , wherein the processor circuitry is configured to execute the machine-readable instructions to cause the processing circuitry to control the display layout to include:
 a first display window including a display of the first media stream; and   a second display window including a display of the second media stream, wherein the first display window has different dimensions from the second display window.   
     
     
         10 . The media receiver of  claim 1 , wherein the processor circuitry is configured to execute the machine-readable instructions to cause the processing circuitry to control the display layout to include:
 a first display window including a display of the first media stream, the first display positioned at a first location selected based on the first source device type; and   a second display window including a display of the second media stream, the second display positioned at a second location selected based on the second source device type.   
     
     
         11 . A method for optimizing a display layout on a display screen, the method comprising:
 receiving, by a communication interface, a first media stream from a first media source;   extracting, by a processor, first metadata from the first media stream;   receiving, by the communication interface, a second media stream from a second media source;   extracting, by the processor, second metadata from the second media stream;   determining, by the processor, a first source device type for the first media source based on a reference to the first metadata;   determining, by the processor, a second source device type for the second media source based on a reference to the second metadata; and   controlling, by the processor, a display layout of the first media stream and the second media stream for display on a sink device based on at least the first source type and the second source type.   
     
     
         12 . The method of  claim 11 , the method further comprising:
 receiving, by the processor, attribute data corresponding to the sink device; and   further controlling, by the processor, the display layout including the first media stream and the second media stream based additionally on the attribute data corresponding to the sink device.   
     
     
         13 . The method of  claim 12 , wherein the attribute data corresponding to the sink device includes a predetermined user viewing distance of the sink device. 
     
     
         14 . The method of  claim 11 , wherein the first metadata includes MAC address classification corresponding to the first media source and the second metadata further includes MAC address classification corresponding to the second media source;
 wherein determining the first source device type for the first media source is based on at least the MAC address classification corresponding to the first media source; and   wherein determining the second source device type for the second media source is based on at least the MAC address classification corresponding to the second media source.   
     
     
         15 . The method of  claim 11 , wherein the first metadata includes Hostname classification corresponding to the first media source and the second metadata further includes Hostname address classification corresponding to the second media source;
 wherein determining the first source device type for the first media source is based on at least the Hostname classification corresponding to the first media source; and   wherein determining the second source device type for the second media source is based on at least the Hostname classification corresponding to the second media source.   
     
     
         16 . The method of  claim 11 , wherein the first metadata includes protocol, aspect ratio, and resolution information of the first media source and the second metadata further includes protocol, aspect ratio, and resolution information of the second media source;
 wherein determining the first source device type for the first media source is based on at least one of the protocol, aspect ratio, or resolution information of the first media source; and   wherein determining the second source device type for the second media source is based on at least one of the protocol, aspect ratio, or resolution information of the second media source.   
     
     
         17 . The method of  claim 11 , wherein the first metadata includes computer vision object detection and computer vision image classification information of the first media source and the second metadata further includes computer vision object detection and computer vision image classification information of the second media source;
 wherein determining the first source device type for the first media source is based on at least one of the computer vision object detection or computer vision image classification information of the first media source; and   wherein determining the second source device type for the second media source is based on at least one of the computer vision object detection or computer vision image classification information of the second media source.   
     
     
         18 . The method of  claim 11 , wherein controlling the display layout includes:
 generating a first display window including a display of the first media stream; and   generating a second display window including a display of the second media stream, wherein the first display window is sized differently from the second display window.   
     
     
         19 . The method of  claim 11 , wherein controlling the display layout includes:
 generating a first display window including a display of the first media stream; and   generating a second display window including a display of the second media stream, wherein the first display window has different dimensions from the second display window.   
     
     
         20 . The method of  claim 11 , wherein controlling the display layout includes:
 generating a first display window including a display of the first media stream, the first display positioned at a first location selected based on the first source device type; and   generating a second display window including a display of the second media stream, the second display positioned at a second location selected based on the second source device type.