Methods and systems for processing synchronous data tracks in a media editing system

Abstract

A software architecture and framework based on plug-in software modules supports flexible handling of synchronous data streams by media production and editing applications. Plug-ins called by the applications convert data from synchronous data streams into a form that enables a user of such an application to view and edit time-synchronous data contained within such data streams. The synchronous data is displayed in a temporally aligned manner in a synchronous data track within a timeline display of the application user interface. In one example, closed caption data extracted from the ancillary portion of a video signal is displayed as text on a data track temporally synchronized with the source video track. Other plug-ins analyze media tracks to generate time-synchronous data which may also be displayed in a temporally aligned manner within a synchronous data track in a timeline.

What is claimed is: 
     
         1 . A method of processing a time-based media track associated with a time-based media project, the method comprising:
 calling a software module that is able to access the time-based media track;   using the software module to analyze the time-based media track to generate time-based analysis results;   reading the time-based media track and the time-based analysis results into a media processing application; and   displaying a time-synchronous data track within a timeline representation of the time-based media project within a graphical user interface of the media processing application, the time-based data track including a temporally synchronized display of the time-based analysis results such that a representation of time-based analysis results associated with a given temporal location within the time-based media track is displayed in the time-synchronous data track timeline representation at a spatial location corresponding to and aligned with the given temporal location in a display of the time-based media track within the graphical user interface of the media processing application.   
     
     
         2 . The method of  claim 1 , wherein analyzing the time-based media track includes detecting motion within a video track and the time-based analysis results include motion vectors. 
     
     
         3 . The method of  claim 1 , wherein analyzing the time-based media track includes analyzing a speech audio track and the time-based analysis results include at least one of phonemes and text. 
     
     
         4 . The method of  claim 1 , wherein analyzing the time-based media track includes detecting faces within a video track and the time-based analysis results include face identification. 
     
     
         5 . The method of  claim 1 , wherein analyzing the time-based media track includes assessing a technical quality of the time-based media track, and the time-based analysis results include evaluations of the technical quality of the time-based media track. 
     
     
         6 . The method of  claim 1 , wherein analyzing the time-based media track includes identifying ambient sounds within a sound track and the time-based analysis results include location detection. 
     
     
         7 . The method of  claim 1 , wherein analyzing the time-based media track includes identifying features within a pictured scene in a video track and the time-based analysis results include location detection. 
     
     
         8 . A method of processing a time-based media track associated with a time-based media project, the method comprising:
 reading the time-based media track into a media processing application;   from the media processing application, calling a software plug-in module;   enabling the software plug-in module to access and analyze the time-based media track to generate time-based analysis results;   generating a time-synchronous data track comprising time-synchronous analysis results; and   displaying the time-synchronous data track within a timeline representation of the time-based media project within a graphical user interface of the media processing application, the time-based data track including a temporally aligned display of the time-synchronous analysis results such that a representation of time-synchronous analysis results associated with a given temporal location within the time-based media track is displayed in the synchronous data track timeline representation at a spatial location corresponding to the given temporal location.   
     
     
         9 . The method of  claim 8 , wherein analyzing the time-based media track includes detecting motion within a video track and the time-based analysis results include motion vectors. 
     
     
         10 . The method of  claim 8 , wherein analyzing the time-based media track includes analyzing a speech audio track and the time-based analysis results include at least one of phonemes and text. 
     
     
         11 . The method of  claim 8 , wherein analyzing the time-based media track includes detecting faces within a video track and the time-based analysis results include face identification. 
     
     
         12 . The method of  claim 8 , wherein analyzing the time-based media track includes assessing a technical quality of the time-based media track, and the time-based analysis results include evaluations of the technical quality of the time-based media track. 
     
     
         13 . The method of  claim 8 , wherein analyzing the time-based media track includes identifying ambient sounds within a sound track and the time-based analysis results include location detection. 
     
     
         14 . The method of  claim 8 , wherein analyzing the time-based media track includes identifying features within a pictured scene in a video track and the time-based analysis results include location detection. 
     
     
         15 . A system comprising:
 a memory for storing computer-readable instructions; and   a processor connected to the memory, wherein the processor, when executing the computer-readable instructions, causes the system to perform a method of processing a time-based media track associated with a time-based media project, the method comprising:
 calling a software module that is able to access the time-based media track; 
 causing the software module to analyze the time-based media track to generate time-based analysis results; 
 reading the time-based media track and the time-based analysis results into a media processing application; and 
 displaying a time-synchronous data track within a timeline representation of the time-based media project within a graphical user interface of the media processing application, the time-based data track including a temporally synchronized display of the time-based analysis results such that a representation of time-based analysis results associated with a given temporal location within the time-based media track is displayed in the time-synchronous data track timeline representation at a spatial location corresponding to and aligned with the given temporal location in a display of the time-based media track within the graphical user interface of the media processing application. 
   
     
     
         16 . A computer program product comprising:
 a non-transitory computer-readable medium with computer program instructions encoded thereon, wherein the computer program instructions, when processed by a computer system, instruct the computer system to perform a method of processing a time-based media track associated with a time-based media project, the method comprising:
 calling a software module that is able to access the time-based media track; 
 causing the software module to analyze the time-based media track to generate time-based analysis results; 
 reading the time-based media track and the time-based analysis results into a media processing application; and 
 displaying a time-synchronous data track within a timeline representation of the time-based media project within a graphical user interface of the media processing application, the time-based data track including a temporally synchronized display of the time-based analysis results such that a representation of time-based analysis results associated with a given temporal location within the time-based media track is displayed in the time-synchronous data track timeline representation at a spatial location corresponding to and aligned with the given temporal location in a display of the time-based media track within the graphical user interface of the media processing application.