Determining Diffuse Image Component Values for Use in Rendering an Image

摘要

Relightable free-viewpoint rendering allows a novel view of a scene to be rendered and relit based on multiple views of the scene from multiple camera viewpoints. Image values from the multiple camera viewpoints can be separated into diffuse image components and specular image components, such that an intrinsic colour component of a relightable texture can be determined for a specular scene, by using the separated diffuse image components. Furthermore, surface normals of geometry in the scene can be refined by constructing a height map based on a conservative component of an initial surface normal field and then determining the refined surface normals based on the constructed height map.

主权项

1. A method of determining an intrinsic colour component of a relightable texture for a scene which includes specular components, wherein a plurality of images of the scene are captured from a respective plurality of camera viewpoints and projected onto geometry which represents objects in the scene, the method comprising:
determining, at each of a plurality of the sample positions of the texture, a diffuse image component value based on the minimum of the image values at the sample position from a set of a plurality of the images; using the diffuse image component values to determine the intrinsic colour component of the relightable texture; and storing the intrinsic colour component of the relightable texture for subsequent use in rendering an image of the scene from a rendering viewpoint under arbitrary lighting conditions.