Method and system for enhancing three dimensional face modeling using demographic classification

摘要

The present invention is a system and method for modeling faces from images captured from a single or a plurality of image capturing systems at different times. The method first determines the demographics of the person being imaged. This demographic classification is then used to select an approximate three dimensional face model from a set of models. Using this initial model and properties of camera projection, the model is adjusted leading to a more accurate face model.

主权项

1. A method for face modeling, comprising the steps of:
(a) processing face detection and facial feature detection on a plurality of images for a person with a single or a plurality of image capturing systems, (b) locating four landmarks on the face of the person based on the facial feature detection, wherein the face is detected by the face detection, and wherein three point features from the four landmarks form a basis plane, (c) training support vector machine (SVM) based demographic classifiers with between one and two thousand images as an input at a learning phase, (d) processing said plurality of images to obtain demographic recognition of the person in the captured images using the support vector machine (SVM) based demographic classifiers, (e) choosing a face model specific to the demographic recognition of the person as an approximate face model, whereby calculation of affine coordinates using demographic dependent constant can be facilitated by the chosen approximate face model, and (f) combining said demographic recognition with affine coordinate based mesh adjustment technique for said face modeling, wherein said demographic recognition comprises gender and ethnicity recognition, and whereby the face modeling is followed by a view generation of the face using rendering tools.