Temporal segment based extraction and robust matching of video fingerprints

摘要

A computer implemented method, apparatus, and computer program product code for temporal, event-based video fingerprinting. In one embodiment, events in video content are detected. The video content comprises a plurality of video frames. An event represents discrete points of interest in the video content. A set of temporal, event-based segments are generated using the events. Each temporal, event-based segment is a segment of the video content covering a set of events. A time series signal is derived from each temporal, event-based segment using temporal tracking of content-based features of a set of frames associated with the each temporal, event-based segment. A temporal segment based fingerprint is extracted based on the time series signal for the each temporal, event-based segment to form a set of temporal segment based fingerprints associated with the video content.

主权项

1. A computer implemented method for temporal, event-based video fingerprinting, the computer implemented method comprising:
extracting content-based features from video content, wherein the video content comprises a plurality of video frames and the content-based features are extracted from each frame of the plurality of video frames; detecting events in the content-based features, wherein each event of the events represents discrete points of interest in the video content; generating a set of temporal, event-based segments using the events, wherein each temporal, event-based segment is a segment of the video content covering a set of the events that span a set of at least two frames of the plurality of video frames and is aligned at an event boundary; deriving a time series signal from each temporal, event-based segment in the set of temporal, event-based segments using temporal tracking of the content-based features of multiple frames associated with the each temporal, event-based segment; and extracting a segment fingerprint based on the time series signal for the each temporal, event-based segment to form a set of temporal segment based fingerprints associated with the video content.