Media content mixing apparatuses, methods and systems

Abstract

In aspects, systems, methods, apparatuses and computer-readable storage media implementing embodiments for mixing audio content based on a plurality of user generated recordings (UGRs) are disclosed. In embodiments, the mixing comprises: receiving a plurality of UGRs, each UGR of the plurality of UGRs comprising at least audio content; determining a correlation between samples of audio content associated with at least two UGRs of the plurality of UGRs; generating one or more clusters comprising samples of the audio content identified as having a relationship based on the determined correlations; synchronizing, for each of the one or more clusters, the samples of the audio content to produce synchronized audio content for each of the one or more clusters, normalizing, for each of the one or more clusters, the synchronized audio content to produce normalized audio content; and mixing, for each of the one or more clusters, the normalized audio content.

1 . A method for mixing audio content based on a plurality of user generated recordings (UGRs), the method comprising:
 receiving a plurality of UGRs, each UGR of the plurality of UGRs comprising at least audio content;   determining a correlation between samples of audio content associated with at least two UGRs of the plurality of UGRs;   generating one or more clusters based on the determined correlations, wherein each of the one or more clusters comprises at least one UGR;   generating, for each of the one or more clusters, synchronization data based on the audio content; and   mixing, for each of the one or more clusters, media content of the plurality of UGRs based at least in part on the synchronization data to produce mixed content.   
     
     
         2 . The method of  claim 1 , further comprising normalizing the media content associated with the UGRs to produce normalized media content, wherein the mixing of the media content comprises mixing the normalized media content to produce the mixed content. 
     
     
         3 . The method of  claim 1 , wherein the mixed media content comprises video content. 
     
     
         4 . The method of any of  claim 1 , wherein the plurality of UGRs are associated with audio content from an event, wherein each of the one or more clusters comprises a set of UGRs, and wherein each set of UGRs is associated with a particular portion of the event. 
     
     
         5 . The method of  claim 4 , further comprising calculating a cross-correlation between different pairs of UGRs, wherein UGRs are associated with particular portions of the event and associated with different clusters based at least in part on the cross-correlations. 
     
     
         6 . The method of  claim 5 , further comprising applying weights during the generating of the one or more clusters, the weights indicating a strength of a relationship between a pair of UGRs of the plurality of UGRs, wherein relationship is indicated by a correlation determined with respect to the pair of UGRs. 
     
     
         7 . The method of  claim 1 , wherein the synchronized data orders the media content for UGRs within each of the clusters with respect to time. 
     
     
         8 . The method of  claim 1 , wherein the normalization is configured to minimize perceptible differences across transitions between one or more UGRs, the transitions corresponding to a start point and an end point associated with a particular UGR, and wherein different UGRs within a particular cluster have different start and/or end points with respect to time. 
     
     
         9 . The method of  claim 1 , wherein the mixing comprises at least one of: a time-frequency domain mixing technique, a segment-wise mixing technique, a target power mixing technique, a maximum component elimination mixing technique, a minimum Variance Mixing (MVM) mixing technique, a segment-wise phase alignment mixing technique, and a maximum component elimination mixing technique. 
     
     
         10 . The method of  claim 1 , further comprising generating a signal signature for each of the plurality of UGRs, wherein the correlation between the samples of the audio content is determined based at least in part on the signal signatures generated for each of the plurality of UGRs. 
     
     
         11 . A method for mixing media content based on a plurality of user generated recordings (UGRs), the method comprising:
 receiving a plurality of UGRs, each UGR of the plurality of UGRs comprising at least audio content;   generating a signal signature for each of the plurality of UGRs;   determining similarities between at least two UGRs of the plurality of UGRs based at least in part on the signal signatures; and   estimating a time offset for each of the plurality of UGRs based at least in part on the signal signatures.   
     
     
         12 . The method of  claim 11 , further comprising:
 generating one or more clusters based on the similarities between the at least two one or more clusters comprises at least one UGR;   generating, for each of the one or more clusters, synchronization data based on the audio content; and   mixing, for each of the one or more clusters, media content of the plurality of UGRs based at least in part on the synchronization data to produce mixed content.   
     
     
         13 . The method of  claim 12 , wherein the synchronization data orders the media content for UGRs within each of the clusters with respect to time. 
     
     
         14 . The method of  claim 12 , wherein the mixed media content comprises video content. 
     
     
         15 . The method of  claim 12 , wherein the mixing comprises at least one of: a time-frequency domain mixing technique, a segment-wise mixing technique, a target power mixing technique, a maximum component elimination mixing technique, a minimum Variance Mixing (MVM) mixing technique, a segment-wise phase alignment mixing technique, and a maximum component elimination mixing technique. 
     
     
         16 . The method of  claim 15 , further comprising normalizing the media content associated with the UGRs to produce normalized media content, wherein the mixing of the media content comprises mixing the normalized media content. 
     
     
         17 . A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations for mixing media content based on a plurality of user generated recordings (UGRs), the operations comprising:
 receiving a plurality of UGRs, each UGR of the plurality of UGRs comprising at least audio content;   generating a signal signature for each of the plurality of UGRs;   determining similarities between at least two UGRs of the plurality of UGRs based at least in part on the signal signatures; and   estimating a time offset for each of the plurality of UGRs based at least in part on the signal signatures.   
     
     
         18 . The non-transitory computer-readable storage medium of  claim 17 , the operations further comprising:
 generating one or more clusters based on the similarities between the at least two one or more clusters comprises at least one UGR;   generating, for each of the one or more clusters, synchronization data based on the audio content; and   mixing, for each of the one or more clusters, media content of the plurality of UGRs based at least in part on the synchronization data to produce mixed content.   
     
     
         19 . The non-transitory computer-readable storage medium of  claim 12 , wherein the synchronization data orders the media content for UGRs within each of the clusters with respect to time. 
     
     
         20 . The non-transitory computer-readable storage medium of  claim 12 , wherein the mixed media content comprises video content.