MULTI VIEW SYNTHESIS METHOD AND DISPLAY DEVICES WITH SPATIAL AND INTER-VIEW CONSISTENCY

摘要

An embodiment of the invention is a method that provides common data and enforces multiple view consistency. In a preferred embodiment, a coordinate alignment matrix is generated after initial warped views are formed. The matrix is used efficiently to repair holes/occlusions when synthesizing final views. In another preferred embodiment, a common background layer is generated based upon initial warped views. Holes are repaired on the common background layer, which can then be used for synthesizing final views. The cost of the latter method is sub-linear, meaning that additional views can be generated with lesser cost. Preferred methods of the invention also use a placement matrix to generate initial warped views, which simplifies warping to a lookup operation.

主权项

1. A method for rendering multiple view data from a stereoscopic video data stream, comprising:
receiving or estimating a disparity map from the stereoscopic data; forming a placement matrix to warp known pixels onto an image plane of a desired view, the placement matrix at position α is defined as:
Pkα(x,y+(k−α)Dk(x,y))=y, where x and y are row and column indices, respectively, and the placement matrix Pkα(x′,y′)=ŷ) provides a pixel location in the reference image that should be mapped on the pixel location (x′,y′) in the virtual view after warping; and with the placement matrix, using a look-up table to conduct image warping.