Multi-perspective stereoscopy from light fields

摘要

Methods and systems for generating stereoscopic content with granular control over binocular disparity based on multi-perspective imaging from representations of light fields are provided. The stereoscopic content is computed as piecewise continuous cuts through a representation of a light field, minimizing an energy reflecting prescribed parameters such as depth budget, maximum binocular disparity gradient, desired stereoscopic baseline. The methods and systems may be used for efficient and flexible stereoscopic post-processing, such as reducing excessive binocular disparity while preserving perceived depth or retargeting of already captured scenes to various view settings. Moreover, such methods and systems are highly useful for content creation in the context of multi-view autostereoscopic displays and provide a novel conceptual approach to stereoscopic image processing and post-production.

主权项

1. A method, using a computer, for generating stereoscopic content from a three-dimensional representation of a light field representing virtual or actual light rays from a scene, wherein the representation is readable in electronic form, the method comprising:
capturing the three-dimensional representation of the light field, wherein the light field includes a plurality of input images; receiving a user-defined two-dimensional map including a set of goal binocular disparities for each pixel of a first image of a stereoscopic image pair with respect to a corresponding pixel of a second image of the stereoscopic image pair, wherein a first goal binocular disparity defined in the two-dimensional map for a first group of pixels is greater than a second goal binocular disparity defined in the two-dimensional map for a second group of pixels; determining a non-planar surface cut through the three-dimensional representation of the light field, wherein the non-planar surface cut is determined using the received two-dimensional map; determining a first two-dimensional subset and a second two-dimensional subset of the three-dimensional representation of the light field, wherein at least one of the first two-dimensional subset and the second two-dimensional subset corresponds to the non-planar surface cut; and generating, using the computer, the first image of the stereoscopic image pair using the first two-dimensional subset and the second image of the stereoscopic image pair using the second two-dimensional subset.