Real time processing of video frames

摘要

A method and system for real time processing of a sequence of video frames. A current frame in the sequence and at least one frame in the sequence occurring prior to the current frame is analyzed. The sequence of video frames is received in synchronization with a recording of the video frames in real time. The analyzing includes performing a background subtraction on the at least one frame, which determines a background image and a static region mask associated with a static region consisting of a contiguous distribution of pixels in the current frame. The static region mask identifies each pixel in the static region upon the static region mask being superimposed on the current frame. A status of a static object is determined as either an abandoned status if the static object is an abandoned object or a removed status if the static object is a removed object.

主权项

1. A method for real time processing of a sequence of video frames, said method comprising:
analyzing, by a processor of a computer system, a current frame in the sequence and at least one frame in the sequence occurring prior to the current frame, each frame comprising a two-dimensional array of pixels and a frame-dependent color intensity at each pixel, said array of pixels in each frame being a totality of pixels in each frame in the sequence of video frames received in synchronization with a recording of the video frames in real time, said analyzing comprising performing a background subtraction on the at least one frame, said performing the background subtraction determining a background image and also determining a static region mask associated with a static region consisting of a contiguous distribution of pixels in the current frame, said static region mask identifying each pixel in the static region upon the static region mask being superimposed on the current frame, said background image comprising the array of pixels and a background model of the at least one frame and not comprising any moving object, said analyzing comprising determining a status of a static object, said status being either an abandoned status if the static object is an abandoned object existing in the static region of the current frame and not existing in the static region of the background image or a removed status if the static object is a removed object existing in the static region of the background image and not existing in the static region of the current frame, wherein said determining the status of the static object comprises executing an abandoned/removed object detection algorithm that uses the current frame, the background image, and the static region mask as input and does not use any other information derived from the background subtraction as input.