Three-dimensional face capturing apparatus and method and computer-readable medium thereof

摘要

Disclosed is a 3D face capturing apparatus, method and computer-readable medium. As an example, the 3D face capturing method includes obtaining a face color image, obtaining a face depth image, aligning, by a computer, the face color image and the face depth image, obtaining, by the computer, a 3D face model by 2D modeling of the face color image and covering a modeled 2D face area on an image output by an image alignment module, removing by the computer, depth noise of the 3D face model, and obtaining, by the computer, an accurate 3D face model by aligning the 3D face model and a 3D face template, and removing residual noise based on a registration between the 3D face model and the 3D face template.

主权项

1. An apparatus capturing a three-dimensional (3D) face, the apparatus comprising:
a color image obtaining unit to obtain a face color image; a depth image obtaining unit to obtain a face depth image; an image alignment module to align the obtained face color image and the obtained face depth image; a 3D face model generating module to perform two-dimensional (2D) modeling of the obtained face color image, and to perform covering of a modeled 2D face area on an image output by the image alignment module to obtain a 3D face model; a first denoising module to remove depth noise of the 3D face model; and a second denoising module to align the 3D face model and a 3D face template, and to remove residual noise based on a registration between the 3D face model and the 3D face template to obtain an accurate 3D face model, wherein the 3D face model generating module performs the 2D modeling using an ellipse face color image, and wherein the first denoising module calculates a scale-independent variance (V) in a depth direction, and compares V with a first threshold to determine whether noise exists in the 3D face model.