Apparatus and Methods for Video Foreground-Background Segmentation with Multi-View Spatial Temporal Graph Cuts

摘要

Embodiments are provided for achieving multi-view video foreground-background segmentation with spatial-temporal graph cuts. A multi-view segmentation algorithm is used where a four-dimensional (4D) graph-cut is constructed by adding links across neighboring views over space and for consecutive frames over time. The segmentation uses both the color values of each input image and the image difference between the input image and the background image to obtain an initial graph-cut, before adding the temporal and spatial links. By using the background subtraction results as the initial segmentation seed, no user annotation is needed to perform multi-view segmentation.

主权项

1. A method for image foreground and background segmentation, the method comprising:
obtaining a plurality of video frames corresponding to a plurality of views for a video stream over time; generating a graph-cut model for the video frames belonging to each one of the views using both color and image difference; adding temporal links to the graph-cut model for each one of the views; generating a four-dimensional graph-cut model for the video frames by adding spatial links to the graph-cut model across the plurality of views; and performing foreground-background segmentation in the plurality of video frames using the four-dimensional graph-cut model.