SYSTEM AND METHOD FOR EDITING VIDEO AND AUDIO CLIPS

摘要

In accordance with an embodiment, a method is disclosed for detecting action in a video clip. An audio clip is extracted from the video clip. The audio clip is converted to an auditory spectrogram. The auditory spectrogram is used to construct a self-similarity matrix. The self-similarity matrix is then used to calculate a novelty curve. The clip is then segmented into segments according to peaks in the novelty curve. Each of segments is scored, and then classified as an action clip if the score is above or below a predetermined threshold. Related methods for folding a digitized song into a shorter version of itself and for sequencing a set of user-supplied video and photo clips to a user-supplied song are further disclosed.

主权项

1. A method for detecting action in a video clip, comprising:
extracting an audio clip from the video clip; converting the audio clip to an auditory spectrogram; using the auditory spectrogram to construct a self-similarity matrix; using the self-similarity matrix to calculate a novelty curve; segmenting the clip into a plurality of segments according to peaks in the novelty curve; scoring each of the plurality of segments; and classifying each of the plurality of segments as an action clip if each segment's score is above or below a predetermined threshold.