Robust video stabilization

摘要

Methods and apparatus for robust video stabilization. A video stabilization technique applies a feature tracking technique to an input video sequence to generate feature trajectories. The technique applies a video partitioning technique to segment the input video sequence into factorization windows and transition windows. The technique smoothes the trajectories in each of the windows, in sequence. For factorization windows, a subspace-based optimization technique may be used. For transition windows, a direct track optimization technique that uses a similarity motion model may be used. The technique then determines and applies warping models to the frames in the video sequence. In at least some embodiments, the warping models may include a content-preserving warping model, a homography model, a similarity transform model, and a whole-frame translation model. The warped frames may then be cropped according to a cropping technique.

主权项

1. A method, comprising:
performing, by one or more computers: obtaining modified two-dimensional (2D) feature trajectories for a plurality of frames of a video sequence; assigning an initial warping score to each frame of the video sequence, the initial warping score indicating one of a plurality of warping models; determining a quality value for each frame according to the modified 2D feature trajectories for the respective frame; adjusting the initial warping score for each frame according to the determined quality value for the respective frame to generate adjusted warping scores for the frames; and warping each frame according to at least one of the plurality of warping models indicated by the adjusted warping score for the respective frame.