SYSTEM AND METHOD FOR VIDEO SUMMARIZATION AND NAVIGATION BASED ON STATISTICAL MODELS

摘要

The disclosed method calculates video time density functions based on inter-frame mutual information or other similarity measures. The method includes acquiring a video sequence from memory, computing mutual information or other similarity measures between two consecutive frames of the video sequence, and constructing a video temporal density function based on the mutual information or similarity measures. The method enables fast navigation of the video sequence by performing a temporal quantization of the video time density function to determine a set of quanta. The video sequence can be navigated using the nearest neighbor video frames to the set of quanta. The method enables thumbnail extraction of a video sequence using statistical modeling by performing a temporal quantization of the video time density function to segment video sequence in time domain and using mixture (such as Gaussian mixture and ICA mixture) vector quantization to find the sample frames for each temporal segment.

主权项

1. A fast-forwarding video content system comprising:
at least one display device; at least one processor; and at least one memory device storing a plurality of instructions which, when executed by the at least one processor, causes the at least one processor to operate with the at least one display device to: a) display a video sequence; b) determine a fast-forward speed factor; c) calculate a similarity measure between two consecutive frames of the video sequence; d) construct a video temporal density function (VTDF) based on the similarity measure; e) perform a temporal quantization of the video temporal density function to determine a set of quanta based on the determined fast-forward speed; and f) display a set of sampled video frames based on the determined set of quanta.