METHOD AND APPARATUS FOR GENERATING VIEWER FACE-TRACING INFORMATION, RECORDING MEDIUM FOR SAME, AND THREE-DIMENSIONAL DISPLAY APPARATUS

摘要

This invention is a method and a device for generating a viewer's face tracking information, a computer-readable recording medium and a three-dimensional display apparatus. It is organized into the following four stages as a method for generating a viewer's face tracking information in order to control the 3D effects of a three-dimensional display apparatus in response to at least one of information about a viewer's viewing direction and distance: (a) stage where the above viewer's facial area is detected from the image extracted from the image input via an image input apparatus installed at the task location of the above three-dimensional display apparatus; (b) stage where facial feature point is detected from the above extracted facial area; (c) stage where the feature point of a standard three-dimensional face model is changed to estimate the optimal transformation matrix which generates a viewer's three-dimensional face model corresponding to the above facial feature points; and (d) stage where at least one of information about the above viewer's viewing direction and distance is estimated based on the above optimal transformation matrix to generate a viewer's face tracking information

主权项

1. A method for generating a viewer's face tracking information in order to control the 3D effects of a three-dimensional display apparatus in response to at least one of information about a viewer's viewing direction and distance. This method is characterized to be composed by the following four stage approach: (a) stage where the above viewer's facial area is detected from the image extracted from the image input via an image input apparatus installed at the task location of the above three-dimensional display apparatus; (b) stage where facial feature point is detected from the above extracted facial area; (c) stage where the feature point of a standard three-dimensional face model is changed to estimate the optimal transformation matrix which generates a viewer's three-dimensional face model corresponding to the above facial feature points; and (d) stage where at least one of information about the above viewer's viewing direction and distance is estimated based on the above optimal transformation matrix to generate a viewer's face tracking information, wherein the stage (a) is,
(a1) stage where the YCbCr color model is drawn up from the RGB color information of the above extracted image, color and brightness information are separated from the color model drawn up and a face candidate area is detected according to the above brightness information; (a2) stage where the rectangular feature point model about the above detected face candidate area is defined and a facial area is detected based on the learning data which the above rectangular feature point model is learned through the AdaBoost learning algorithm; and (a3) stage where the above detected facial area is determined as a valid facial area when the size of the result value of the above AdaBoost (CFH(x) in [Equation 1] described below) exceeds a predetermined threshold value, wherein [Equation 1] comprises:CFH(x)=∑m=1Mhm(x)-θ wherein M: the total number of weak classifiers composed of the strong classifier hm(x): the output value in the mth weak classifier θ: empirically set up as the value used to control the error rate of the strong classifier more minutely