VIDEO-BASED MOTION CAPTURE AND ADAPTATION

摘要

The disclosure provides an approach for estimating a state-space controller from a set of video frames depicting a motion of an entity. The approach includes incrementally optimizing parameters of the state-space controller and changing a structure of the state-space controller based on expanding subsets of the set of video frames. In one embodiment, a controller-estimation application greedily selects, at every stage of the incremental optimization, structure and parameters of the controller which minimize an objective function. In another embodiment, the controller-estimation application re-optimizes, after the incremental optimization, all parameters of the state-space controller based on all of the video frames. In yet a further embodiment, the controller-estimation application alters the structure of the state-space controller for robustness and compactness by adding cycles in the state-space controller and enforcing constraints on the structure of the state-space controller and adding and modifying state transition types, as appropriate.

主权项

1. A computer-implemented method for estimating a state-space controller from a set of video frames, comprising:
receiving the set of video frames, wherein the video frames depict a motion of an entity; initializing, via one or more processors, the state-space controller, wherein the state-space controller includes states corresponding to an atomic controller and transitions between the states; and incrementally optimizing parameters of the state-space controller and changing a structure of the state-space controller to approximate through simulation the motion as depicted in an initial subset of the video frames and in expanded subsets of the video frames, wherein parameters of a last one or more states of the state-space controller are optimized at each stage of the incremental optimization.