System and method for aligning video sequences

摘要

Methods and Systems for aligning multiple video sequences of a similar scene. It is determined which video sequences should be aligned with each other using linear dynamic system (LDS) modeling. The video sequences are then spatially aligned with each other.

主权项

1. A system for aligning at least two video sequences of at least one similar non-rigid scene, including, but not limited to:
at least one application operable on at least one computer, the at least one application configured for: determining, utilizing at least one comparing videos application operable on at least one computer, which of the at least two video sequences should be aligned with each other, the determining including, but not limited to: modeling each video sequence as output of at least one linear dynamic system (LDS); jointly identifying parameters from at least two LDSs associated to the at least two video sequences of the at least one similar non-rigid scene stacked into a single matrix; transforming the parameters of all LDSs to a canonical form where the parameters of different video sequences are expressed with respect to a same basis; extracting features from the parameters of the LDSs; and using an image alignment algorithm to find a spatial transformation relating the features in order to spatially align the at least two video sequences with each other, wherein spatial alignment is found independent of temporal alignment.