Altering streaming video encoding based on user attention

Abstract

Disclosed are various embodiments for adjusting the encoding of a video signal into a video stream based on user attention. A first portion of a first video frame is encoded at a lower quality level than a second portion of the first video frame based, at least in part, on a rate of change of objects portrayed in the second portion. The first and second encoded portions are displayed in a second video frame.

Therefore, the following is claimed: 
     
         1 . A system, comprising:
 one or more processors; and   memory to store computer-executable instructions that, if executed, cause the one or more processors to:
 encode a first portion of a first video frame at a lower quality level than a second portion of the first video frame based, at least in part, on a rate of change of objects portrayed in the second portion; and 
 display the first and second encoded portions in a second video frame. 
   
     
     
         2 . The system of  claim 1 , wherein the computer-executable instructions, if executed, further cause the one or more processors to detect the rate of change of objects portrayed in the second portion by comparing the first video frame with at least one previous video frame. 
     
     
         3 . The system of  claim 1 , wherein the computer-executable instructions, if executed, further cause the one or more processors to detect the rate of change of objects portrayed in the second portion based, at least in part, on the first video frame and a stored profile associated with an application that generates a video signal that includes the first video frame. 
     
     
         4 . The system of  claim 1 , wherein the computer-executable instructions, if executed, further cause the one or more processors to detect the rate of change of objects portrayed in the second portion based, at least in part, on receiving an event indication from an application that generates a video signal that includes the first video frame. 
     
     
         5 . The system of  claim 1 , wherein the computer-executable instructions, if executed, further cause the one or more processors to predict that a user attention would be drawn to the second portion instead of the first portion due to the rate of change of objects portrayed in the second portion. 
     
     
         6 . The system of  claim 1 , wherein the computer-executable instructions, if executed, further cause the one or more processors to predict that the rate of change of objects portrayed in the second portion is a saccade-inducing event. 
     
     
         7 . A method, comprising:
 encoding a first portion of a first video frame at a lower quality level than a second portion of the first video frame based, at least in part, on a rate of change of objects portrayed in the second portion; and   displaying the first and second encoded portions in a second video frame.   
     
     
         8 . The method of  claim 7 , further comprising determining that the rate of change of objects portrayed in the second portion meets one or more thresholds. 
     
     
         9 . The method of  claim 7 , further comprising detecting the rate of change of objects portrayed in the second portion by comparing the first video frame with at least one previous video frame. 
     
     
         10 . The method of  claim 7 , further comprising detecting the rate of change of objects portrayed in the second portion based, at least in part, on the first video frame and a stored profile associated with an application that generates a video signal that includes the first video frame. 
     
     
         11 . The method of  claim 7 , further comprising detecting the rate of change of objects portrayed in the second portion based, at least in part, on receiving an event indication from an application that generates a video signal that includes the first video frame. 
     
     
         12 . The method of  claim 7 , wherein the lower quality level is associated with at least one of: a lower resolution, a lower frame rate, a lower bitrate, or a lower color depth. 
     
     
         13 . The method of  claim 7 , further comprising predicting that a user attention would be drawn to the second portion instead of the first portion due to the rate of change of objects portrayed in the second portion. 
     
     
         14 . The method of  claim 7 , further comprising predicting that the rate of change of objects portrayed in the second portion is a saccade-inducing event. 
     
     
         15 . The method of  claim 7 , wherein the first and second portions are distinct. 
     
     
         16 . The method of  claim 7 , wherein the first portion includes all of the first video frame other than the second portion. 
     
     
         17 . A non-transitory computer-readable medium storing computer-executable instructions that, if executed, cause one or more processors to:
 encode a first portion of a first video frame at a lower quality level than a second portion of the first video frame based, at least in part, on a rate of change of objects portrayed in the second portion; and   display the first and second encoded portions in a second video frame.   
     
     
         18 . The non-transitory computer-readable medium of  claim 17 , wherein computer-executable instructions, if executed, further cause the one or more processors to predict that the rate of change of objects portrayed in the second portion is a saccade-inducing event. 
     
     
         19 . The non-transitory computer-readable medium of  claim 17 , wherein the computer-executable instructions, if executed, further cause the one or more processors to detect the rate of change of objects portrayed in the second portion by comparing the first video frame with at least one previous video frame. 
     
     
         20 . The non-transitory computer-readable medium of  claim 17 , wherein the computer-executable instructions, if executed, further cause the one or more processors to predict that a user attention would be drawn to the second portion instead of the first portion due to the rate of change of objects portrayed in the second portion.