System and method for shot change detection in a video sequence

摘要

A computer implemented method for automatically identifying shot changes in a video sequence in real-time or near-real-time is disclosed. Optical flow energy change differences between frames, sum-of-square differences between optical-flow-compensated frames, and hue histogram changes within frames are analyzed and stored in frame buffers. A feature vector formed from a combination of these measurements is compared to a feature vector formed from thresholds based on tunable recall and precision to declare the presence or absence of a shot change.

主权项

1. A method, comprising:
receiving, by a processor, a plurality of images; determining, by the processor, an image similarity metric based on at least one pair of images of the plurality of images, wherein the similarity metric comprises determining an optical flow energy change difference measure (OFEDM) between optical flow fields comprising:
calculating a first optical flow field between a current image and a previous frame and a second optical flow field between the previous image and a previous third image;comparing the first optical flow field to the second optical flow field by multiplying a scaled angle difference by a scaled magnitude difference for each pixel to arrive at a similarity scalar value for each pixel; andcalculating a mean value of each of the similarity scalar values as the per pixel OFEDM; and detecting, by the processor, a shot change in the plurality of image upon the mean of the per pixel OFEDM exceeding a user-supplied threshold.