Methods for Full Parallax Compressed Light Field Synthesis Utilizing Depth Information

摘要

An innovative method for synthesis of compressed light fields is described. Compressed light fields are commonly generated by sub-sampling light field views. The suppressed views must then be synthesized at the display, utilizing information from the compressed light field. The present invention describes a method for view synthesis that utilizes depth information of the scene to reconstruct the absent views. An innovative view merging method coupled with an efficient hole filling procedure compensates for depth misregistrations and inaccuracies to produce realistic synthesized views for full parallax light field displays.

主权项

1. A method for synthesis of a light field from a data set representing a plurality of predetermined views and respective disparity values comprising:
a) projecting the plurality of predetermined views using the respective disparity values to a single view position to provide a number of predetermined views at the single view position that is equal to the number of the predetermined views; b) merging the plurality of predetermined views to define a merged view, wherein the merging includes;
i) evaluating each of the plurality of predetermined views to determine an apparent reliability of each predetermined view;ii) for each pixel, selecting the most apparently reliable view not previously selected and using the respective disparity value or noting a position of a hole;iii) again selecting the most apparently reliable view not previously selected and filling holes found in ii) if hole filling pixels are present;iv) repeating ii) and iii) for still further predetermined views until all predetermined views have been processed; and c) performing a hole-filling operation on the merged view to define a synthesized light field for display.