Estimating Surface Properties Using a Plenoptic Camera

摘要

A plenoptic camera captures a plenoptic image of an object illuminated by a point source (preferably, collimated illumination). The plenoptic image is a sampling of the four-dimensional light field reflected from the object. The plenoptic image is made up of superpixels, each of which is made up of subpixels. Each superpixel captures light from a certain region of the object (i.e., a range of x,y spatial locations) and the subpixels within a superpixel capture light propagating within a certain range of directions (i.e., a range of u,v spatial directions). Accordingly, optical properties estimation, surface normal reconstruction, depth estimation, and three-dimensional rendering can be provided by processing only a single plenoptic image. In one approach, the plenoptic image is used to estimate the bidirectional reflectance distribution function (BRDF) of the object surface.

主权项

1. A method implemented on a computer system for estimating surface properties of an object, the method comprising:
accessing a plenoptic image of the object illuminated by a point source, the plenoptic image comprising a plurality of superpixels, each superpixel capturing light reflected from a certain region of the object, and each superpixel comprising a plurality of subpixels, each subpixel capturing light reflected over a certain range of propagation directions; and processing the subpixels to estimate the surface properties of the object.