Cascaded camera motion estimation, rolling shutter detection, and camera shake detection for video stabilization

摘要

An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.

主权项

1. A computer-implemented method, comprising:
accessing a video; generating a plurality of tracked features for each of at least two adjacent frames of the video, the tracked features of the adjacent frames indicating an inter-frame motion of the camera; applying a homographic model to the inter frame motion to determine a number of tracked features that are inliers matching the homographic model, wherein the homographic model has eight degrees of freedom; applying a homographic mixture model to the inter frame motion to determine a number of tracked features that are inliers matching the homographic mixture model, the homographic mixture model estimated using a plurality of different homographic models, the homographic model and the homographic mixture model each representing different types of motion; determining that the number of homographic mixture inliers exceeds the number of homographic inliers by a threshold; and generating a stabilized video by applying the homographic mixture model to the adjacent frames of the video.