System and Method for Automated Video Editing

Abstract

A system and method for automated video editing. A reference media is selected and analyzed. At least one video may be acquired, and thereby synced to the reference audio media. Once synced, audio analysis is used to assemble an edited video. The audio analysis can include information, including user inputs, video analysis, and metadata. The system and method for automated video editing may be applied to collaborative creation, simulated stop motion animation, and real-time implementations.

1 . A Method for editing media comprising:
 acquiring a first media item;   partitioning the first media item into a plurality of frames, the plurality of frames capturing all samples of the first media item;   determining locations of a plurality of onsets within the first media item by analyzing all of the plurality of frames of the first media item;   obtaining and recording a plurality of second media items;   aligning a starting point of each of the second media items with a starting point of the first media item;   partitioning the plurality of second media items based upon the determined locations of the plurality of onsets from the first media item; and   creating a composite media file by selecting and combining in series a plurality of the partitions from the plurality of second media items based at least in part upon the determined onsets.   
     
     
         2 . The method for editing media of  claim 1 ;
 wherein the selecting the plurality of partitions further comprises:
 selecting partitions based upon a user input; 
 selecting partitions randomly; 
 selecting partitions based upon video analysis; 
 selecting partitions based upon meta-data information within the second media items; 
 selecting partitions based upon information of a creator or creators of the second media items; and/or 
 combinations thereof. 
   
     
     
         3 . The method for editing media of  claim 2 ;
 wherein selecting partitions based upon video analysis further comprises:
 determining a best focus of partitions of the second media items; 
 determining an association of motion within the second media items to the first media item; 
 determining contrast, brightness, or image-entropy; and/or 
 combinations thereof. 
   
     
     
         4 . The method for editing media of  claim 2 ;
 wherein selecting partitions based upon meta-data further comprises:
 determining a location of where the second media item was created; and/or 
 determining the type of location recorded in the second media item. 
   
     
     
         5 . The method for editing media of  claim 2 ;
 wherein selecting partitions based upon information of a creator or creators of the second media items further comprises:
 determining the age and/or gender of a creator or creators of the second media items; 
 determining if the creator or creators are a part of a group; 
 determining if a creator or creators prefer partitions from the second media items; and/or 
 combinations thereof. 
   
     
     
         6 . A Method for synchronizing video comprising:
 obtaining a video media item having a first length of time;   determining onsets or interesting times within said video media item at specific times within the first length of time;   partitioning the video media item into a plurality of partitions based upon said onsets or interesting times;   obtaining a first media item having a second length of time;   determining a plurality of onsets within the first media item; and   adjusting a length of time of at least one of the plurality of partitions of the video media item so that onsets from the first media item match, in time, with onsets or interesting times of the video media item.   
     
     
         7 . The method for synchronizing media of  claim 6 ;
 wherein the adjusting comprises speeding up or slowing down the at least one of the plurality of partitions.   
     
     
         8 . A Method for editing and creating media collaboratively comprising:
 obtaining a first media item;   partitioning the first media item into a plurality of frames, the plurality of frames capturing all samples of the first media item;   determining locations of a plurality of onsets within said first media item by analyzing all of the plurality of frames of the first media item;   generating a first second media item from a first user;   generating an additional second media item from an additional user;   aligning a starting point of each of the second media items with a starting point of the first media item;   partitioning the second media items based upon the determined locations of the plurality of onsets from the first media item;   creating a composite media file by combining in series a plurality of the partitions from the second media items based upon the determined onsets.   
     
     
         9 . A method for editing source media into a composite video and applying effects using an existing edit decision list (EDL) comprising:
 partitioning source media based on information in the EDL;   sorting the partitioned source media into two or more intermediate tracks;   combining, upon playback, the intermediate tracks in series or using a blend visual effect; and   applying, upon playback, one or more visual effects to at least one item selected from the group consisting of:
 the partitioned source media; 
 the two or more intermediate tracks; and 
 the combined video. 
   
     
     
         10 . The method for editing source media into a composite video and applying effects using an existing edit decision list (EDL) of  claim 9 ;
 wherein the blend visual effect is a dissolve effect.   
     
     
         11 . The method for editing source media into a composite video and applying effects using an existing edit decision list (EDL) of  claim 9 ;
 wherein the blend visual effect is a picture-in-picture effect.   
     
     
         12 . The method for editing source media into a composite video and applying effects using an existing edit decision list (EDL) of  claim 9 ;
 wherein the one or more visual effects include visual effects which conform the partitioned source media to a format of the combined video.   
     
     
         13 . The method for editing source media into a composite video and applying effects using an existing edit decision list (EDL) of  claim 12 ;
 wherein the conforming the partitioned source media includes:
 adjusting a brightness and contrast; and/or 
 adjusting a rotation. 
   
     
     
         14 . The method for editing source media into a composite video and applying effects using an existing edit decision list (EDL) of  claim 8 ;
 wherein the one or more visual effects comprises at least one visual effect selected from the group consisting of:
 adjusting the color or contrast of the combined video; 
 applying an overlay image; 
 enhancing edges, faces, or other parts of the image; 
 simulating drawing, panting or other artistic style; 
 simulating a style created by a camera or filming process. 
   
     
     
         15 . The method for editing source media into a composite video and applying effects using an existing edit decision list (EDL) of  claim 8 ;
 wherein a user, via a single input, applies the one or more visual effects to the composite video.   
     
     
         16 . The method for editing media of  claim 1 ;
 wherein said analyzing all of the plurality of frames of the first media item comprises conducting frequency analysis on the first media item.   
     
     
         17 . The method for editing media of  claim 1 ;
 wherein said analyzing all of the plurality of frames of the first media item comprises conducting time-domain analysis on the first media item.   
     
     
         18 . The method for editing media of  claim 1 ;
 wherein the onsets are determined automatically and without user interaction.   
     
     
         19 . The method for editing media of  claim 1 ;
 wherein said analyzing all of the plurality of frames of the first media item comprises filtering at least one of the plurality of frames using at least one filter.   
     
     
         20 . The method for editing media of  claim 1 ;
 wherein said analyzing the plurality of frames of the first media item comprises filtering at least one of the plurality of frames using at least one filter in the frequency domain.