Joint Video Deblurring and Stabilization

摘要

Joint video deblurring and stabilization techniques are described. In one or more implementations, a deblurring and stabilization module is configured to jointly deblur and stabilize a video by grouping video frames into spatial-neighboring frame clusters, and building local mesh homographies for video frames in each spatial-neighboring frame cluster.

主权项

1. A computer-implemented method comprising:
identifying one or more blurry patches in one or more video frames of a video; for each blurry patch, performing a local search, using a spatial frame registration, to identify a corresponding sharp patch in a spatial-neighboring video frame to replace the blurry patch, the spatial frame registration mapping pixels in a spatial-neighboring video frame to corresponding pixels in other spatial-neighboring video frames; refining local mesh homographies based on the local search, each of the local mesh homographies comprising a mesh of multiple regions corresponding to a video frame, and each region comprising a homography that provides a mapping between a region in the video frame and a corresponding region in a different video frame; stabilizing the refined local mesh homographies; and rendering a deblurred and stabilized video, using the refined and stabilized local mesh homographies, by replacing the one or more blurry patches in the one or more video frames with corresponding sharp patches.