Synchronizing Audio and Video Components of an Automatically Generated Audio/Video Presentation

摘要

Some embodiments provide an application that can automatically generate a movie from a collection of media clips stored on a device or accessible by the device. The movie creation process of some embodiments uses novel video and audio compositors that dynamically composite video and audio components of the movie. The video compositors process explores different combination of media clips and media-clip arrangements to produce an interesting video presentation. The audio compositor receives the duration of the video presentation, and dynamically generates a song for the video presentation based on this duration. Another novel interaction is that in some embodiments the audio compositor provides the starting location of its last segment to the video compositor so that the video compositor can align the start of the last video segment with this ending segment. In some embodiments, the video and audio compositors also synchronize fade-out effects that they apply to their respective presentations with each other. Also, in some embodiments, the video compositor can ask the audio compositor for one or more audio onsets that are near a particular time in the presentation. In some of these embodiments, the audio compositor returns (1) a list of onsets that are near a time that is specified by the video compositor, and (2) a priority for each of these onsets. The video compositor then uses this list of onsets to align an edit point in the composite video's definition to the location of one of the onsets based the specified priority value(s) and the desirability of the video edit at the onset location.

主权项

1. A non-transitory machine readable medium storing a program for automatically generating an audio/video (A/V) presentation from a collection of media clips stored on a device, said A/V presentation comprising an audio component and a video component, the program comprising:
a video compositing process and an audio compositing process, the video compositing process to explore different combination of media clips and media-clip arrangements in order to define the video component, and to provide to the audio compositing process a duration of the video component from the video compositing process; and the audio compositing process to generate dynamically the audio component for the A/V presentation based on this duration.