Recovering dis-occluded areas using temporal information integration

摘要

A temporal information integration dis-occlusion system and method for using historical data to reconstruct a virtual view containing an occluded area. Embodiments of the system and method use temporal information of the scene captured previously to obtain a total history. This total history is warped onto information captured by a camera at a current time in order to help reconstruct the dis-occluded areas. The historical data (or frames) from the total history match only a portion of the frames contained in the captured information. This warping yields warped history information. Warping is performed by using one of two embodiments to match points in an estimation of the current information to points in the captured information. Next, regions of current information are split using a classifier. The warped history information and the captured information then are merged to obtain an estimate for the current information and the reconstructed virtual view.

主权项

1. A method for processing image data, the method comprising:
receiving, by a computing device, captured image data representing a visual depiction of a scene at a first time; receiving, by the computing device, historical image data representing at least one other visual depiction of at least a portion of the scene at at least one other time; generating, by the computing device, a virtual view of the scene, including:
warping at least a portion of the historical image data onto the captured image data according to a motion model, wherein the warping includes:
estimating the warping for at least a portion of the scene;splitting at least the portion of the scene into a plurality of regions according to a recursive region splitting process that employs determinations of matched and unmatched points between the captured image data and the historical image data; andperforming a local refinement of the estimated warping on a per-region basis; and outputting the generated virtual view of the scene.