Videolens media engine

摘要

A system, method, and computer program product for automatically analyzing multimedia data are disclosed. Embodiments receive multimedia data, detect portions having specified features, and output a corresponding subset of the multimedia data. Content features from downloaded or streaming movies or video clips are identified as a human probably would do, but in essentially real time. Embodiments then generate an index or menu based on individual consumer preferences. Consumers can peruse the index, or produce customized trailers, or edit and tag content with metadata as desired. The tool can categorize and cluster content by feature, to assemble a library of scenes or scene clusters according to user-selected criteria.

主权项

1. A method for automated analysis of multimedia data, the method comprising:
receiving multimedia data at a computing device including a computer processor programmed to analyze the multimedia data; identifying at least one multimedia data portion having specified content features via the computer processor analyzing the multimedia data by identifying:
at least one action scene in the multimedia data based on audio signal amplitude and motion vector magnitude;at least one low motion scene in the multimedia data based on macro-block size and motion vector magnitude;at least one previewing frame in the multimedia data based on color histograms taken from sampled candidate frames; andat least one human dialogue in the multimedia data based on mel frequency cepstrum coefficients (MFCC) of an audio sample; and responsively outputting the at least one identified multimedia data portion.