INCREMENTAL LEARNING FRAMEWORK FOR OBJECT DETECTION IN VIDEOS

摘要

Techniques disclose an incrementally expanding object detection model. An object detection tool identifies, based on an object detection model, one or more objects in a sequence of video frames. The object detection model provides an object space including a plurality of object classes. Each object class includes one or more prototypes. Each object is classified as being an instance of one of the object classes. Each identified object is tracked across at least one of the frames. The object detection tool generates a measure of confidence for that object based on the tracking. Upon determining that the measure of confidence exceeds a threshold, the object detection tool adds a prototype of the instance to the object detection model.

主权项

1. A method, comprising:
identifying, based on an object detection model, one or more objects in a first sequence of video frames of a plurality of sequences of video frames, wherein the object detection model provides an object space including a plurality of object classes, wherein each object class is represented by one or more prototypes, and wherein each object is classified as being an instance of one of the object classes; and for each identified object:
tracking the object across at least one of the frames,generating a measure of confidence for the object based on the tracking, wherein the measure of confidence indicates a degree that the object does not correspond to any of the one or more prototypes currently associated with the object class, andupon determining that the measure of confidence exceeds a threshold, adding a prototype representative of the instance to the object detection model.