Feature-based Video Annotation

摘要

A system and methodology provide for annotating videos with entities and associated probabilities of existence of the entities within video frames. A computer-implemented method identifies an entity from a plurality of entities identifying characteristics of video items. The computer-implemented method selects a set of features correlated with the entity based on a value of a feature of a plurality of features, determines a classifier for the entity using the set of features, and determines an aggregation calibration function for the entity based on the set of features. The computer-implemented method selects a video frame from a video item, where the video frame having associated features, and determines a probability of existence of the entity based on the associated features using the classifier and the aggregation calibration function.

主权项

1. A computer-implemented method for annotating videos with entities and associated probabilities of existence of the entities within video frames, the method comprising:
identifying an entity from a plurality of entities identifying characteristics of video items; selecting a set of features correlated with the entity based on a value of a feature of a plurality of features; determining a classifier for the entity using the set of features; determining an aggregation calibration function for the entity based on the set of features; selecting a video frame from a video item, the video frame having associated features; and determining a probability of existence of the entity based on the associated features using the classifier and the aggregation calibration function.