Constructing 3D Surfaces for Multi-Color Objects

摘要

This document describes techniques and apparatuses for constructing three dimensional (3D) surfaces for multi-colored objects. In some aspects, these techniques determine, from a color image and coarse depth information, an illumination model and albedo for a multi-color object. The coarse depth information may then be refined based on the illumination model and combined with the albedo to provide a 3D surface of the multi-color object.

主权项

1. A computer-implemented method comprising:
receiving a color image of a multi-color object; receiving coarse depth information for the multi-color object; determining, based on the color image and the coarse depth information, an illumination model and albedo for the multi-color object, the albedo determined at least in part by estimating chromaticity information for the color image and regularizing the albedo with pairwise weights defined using the estimated chromaticity information; determining, based on the illumination model and the coarse depth information, refined depth information for the multi-color object; and constructing, based on the albedo and the refined depth information, a relightable three-dimensional (3D) surface of the multi-color object.