Real-time Adaptation of Audio Playback

Abstract

A method includes determining one or more audio characteristics of a first digital signal representing a first portion of streaming media content provided by a media playback application to an audio output component; playing the first portion of the media content into an environment; capturing, by an audio output component, a second digital signal representing the first portion of the media content as played; determining, based on the captured second digital signal, one or more detected audio characteristics of the media content as played into the environment; determining a difference between the one or more audio characteristics of the media content and the one or more detected audio characteristics; calibrating a second portion of the media content based on the difference and based on a determination that the second portion is to be calibrated; and playing, by the audio output component into the environment, the second portion as calibrated.

1 .- 20 . (canceled) 
     
     
         21 . A device comprising:
 an audio output controller communicatively linked to:   an audio output component,   an audio input component, and   one or more media playback applications; and   one or more processors operable to perform operations, the operations comprising:
 determining, by the audio output controller during a dynamic audio calibration process and based on a first digital signal representing a first portion of streaming media content provided by a first media playback application to the audio output component, one or more audio characteristics of the streaming media content; 
 playing, by the audio output component into an environment, the first portion of the streaming media content; 
 capturing, by the audio input component, a second digital signal representing the first portion of the streaming media content as played by the audio output component into the environment; 
 determining, based on the captured second digital signal, one or more detected audio characteristics of the streaming media content as played into the environment; 
 determining a difference between the one or more audio characteristics of the streaming media content and the one or more detected audio characteristics of the streaming media content; 
 calibrating a second portion of the streaming media content based on the difference and based on a determination that the second portion is to be calibrated; 
 playing, by the audio output component to the environment, the second portion as calibrated; 
 detecting a change from the first media playback application to a second media playback application; 
 responsive to the detecting, calibrating a second streaming media content provided by the second media playback application; and 
 playing, by the audio output component to the environment, the calibrated second streaming media content. 
   
     
     
         22 . The device of  claim 21 , the operations further comprising:
 determining the first digital signal representing the first portion of the streaming media content; and   providing the first portion of the streaming media content to the audio output component of the device after the determining of the first digital signal.   
     
     
         23 . The device of  claim 21 , the operations further comprising:
 receiving the streaming media content from a third party content provider over a communications network.   
     
     
         24 . The device of  claim 21 , wherein the operations for the determining of the one or more audio characteristics of the streaming media content further comprises:
 determining one or more artist-intended audio characteristics of the streaming media content by tapping into the first portion of the streaming media content, wherein the tapping occurs subsequent to the first portion being provided by the first media playback application, and prior to the first portion being received by the audio output component.   
     
     
         25 . The device of  claim 21 , wherein the calibrating of the second portion of the streaming media content comprises applying the difference as an input to a machine learning model in order to determine an output audio setting. 
     
     
         26 . The device of  claim 25 , wherein the machine learning model is an artificial neural network. 
     
     
         27 . The device of  claim 21 , the operations further comprising:
 applying a trained machine learning model to optimize the captured second digital signal prior to the determining of the difference between the one or more audio characteristics of the streaming media content and the one or more detected audio characteristics of the streaming media content.   
     
     
         28 . The device of  claim 21 , the operations further comprising:
 applying a trained machine learning model to automatically respond to user preferences.   
     
     
         29 . The device of  claim 21 , the operations further comprising:
 determining a target output signal by determining a value offset for an audio output associated with the device, and wherein the calibrating of the second portion further comprising:   calibrating the second portion to be within a threshold of the target output signal.   
     
     
         30 . The device of  claim 29 , the operations further comprising:
 playing, by the audio output component to a test environment of the device, a test signal; and   capturing, by the audio input component, the test signal as played into the test environment, and   wherein the value offset is based on a difference between respective spectral shapes of the test signal as played and the test signal as captured.   
     
     
         31 . The device of  claim 29 , the operations further comprising:
 generating a test signal based on at least one of the environment, the device, or the first media playback application;   playing, by the audio output component to the environment of the device, the test signal as generated; and   capturing, by the audio input component, the test signal as played into the environment, and   wherein the value offset is based on a difference between respective spectral shapes of the test signal as played and the test signal as captured.   
     
     
         32 . The device of  claim 29 , wherein determining the target output signal is based on a user profile, wherein the user profile is based on a user indication via a display component of the device, or a history of user preferences, or both. 
     
     
         33 . The device of  claim 21 , the operations further comprising:
 triggering the capturing of the second digital signal.   
     
     
         34 . The device of  claim 33 , the operations further comprising:
 detecting a movement of the device, and   wherein the triggering is performed in response to a determination that a movement measurement exceeds a threshold value.   
     
     
         35 . The device of  claim 33 , wherein the triggering is based on one or more of: (i) a change in the streaming media content, (ii) an amount of elapsed time since a prior calibration was performed, or (iii) detecting a change from the first media playback application to the second media playback application. 
     
     
         36 . The device of  claim 21 , wherein the audio output component comprises a plurality of speakers, and the operations further comprising:
 detecting one or more active speakers of the plurality of speakers, and   wherein the calibrating of the second portion is performed to calibrate the second portion to be played from the one or more active speakers.   
     
     
         37 . The device of  claim 21 , the operations further comprising:
 determining a type of the environment; and   determining that the second portion of the streaming media content is not to be calibrated based on the type of the environment.   
     
     
         38 . The device of  claim 21 , wherein the one or more media playback applications are installed on the device, and wherein the audio output controller is configured to securely access streaming media content played by the one or more media playback applications. 
     
     
         39 . A computer-implemented method comprising:
 determining, during a dynamic audio calibration process and based on a first digital signal representing a first portion of streaming media content provided by a first media playback application to an audio output component, one or more audio characteristics of the streaming media content;   playing, by the audio output component into an environment, the first portion of the streaming media content;   capturing, by an audio input component, a second digital signal representing the first portion of the streaming media content as played by the audio output component into the environment;   determining, based on the captured second digital signal, one or more detected audio characteristics of the streaming media content as played into the environment;   determining a difference between the one or more audio characteristics of the streaming media content and the one or more detected audio characteristics of the streaming media content;   calibrating a second portion of the streaming media content based on the difference and based on a determination that the second portion is to be calibrated;   playing, by the audio output component to the environment, the second portion as calibrated;   detecting a change from the first media playback application to a second media playback application;   responsive to the detecting, calibrating a second streaming media content provided by the second media playback application; and   playing, by the audio output component to the environment, the calibrated second streaming media content.   
     
     
         40 . An article of manufacture including a non-transitory computer-readable medium, having stored thereon program instructions that, upon execution by one or more processors of a computing device, cause the computing device to carry out operations comprising:
 determining, during a dynamic audio calibration process and based on a first digital signal representing a first portion of streaming media content provided by a first media playback application to an audio output component, one or more audio characteristics of the streaming media content;   playing, by the audio output component into an environment, the first portion of the streaming media content;   capturing, by an audio input component, a second digital signal representing the first portion of the streaming media content as played by the audio output component into the environment;   determining, based on the captured second digital signal, one or more detected audio characteristics of the streaming media content as played into the environment;   determining a difference between the one or more audio characteristics of the streaming media content and the one or more detected audio characteristics of the streaming media content;   calibrating a second portion of the streaming media content based on the difference and based on a determination that the second portion is to be calibrated;   playing, by the audio output component to the environment, the second portion as calibrated;   detecting a change from the first media playback application to a second media playback application;   responsive to the detecting, calibrating a second streaming media content provided by the second media playback application; and   playing, by the audio output component to the environment, the calibrated second streaming media content.