Automated facial action coding system

摘要

An automatic facial action coding system and method can include processing an image to identify a face in the image, to detect and align one or more facial features shown in the image, and to define one or more windows on the image. One or more distributions of pixels and color intensities can be quantified in each of the one or more windows to derive one or more two-dimensional intensity distributions of one or more colors within the window. The one or more two-dimensional intensity distributions can be processed to select image features appearing in the one or more windows and to classify one or more predefined facial actions on the face in the image. A facial action code score that includes a value indicating a relative amount of the predefined facial action occurring in the face in the image can be determined for the face in the image for each of the one or more predefined facial actions.

主权项

1. A method comprising:
applying a plurality of image filters to each of a plurality of image windows defined at a plurality of locations in a face in an image to produce a set of descriptors representing contents of each of the plurality of image windows; processing outputs of the plurality of image filters for the plurality of image windows using a feature selection stage, the feature selection stage comprising choosing a subset of the set of descriptors for each of the plurality of image windows; estimating a first relative likelihood of a predefined facial action unit occurring in each of the plurality of image windows, the first relative likelihood for each of the plurality of image windows being based on the subset of the set of descriptors for each of the plurality of image windows; and producing a facial action code score for the face for the predefined facial action unit, the facial action code score quantifying a second relative likelihood of a presence of the predefined facial action unit in the face, the quantifying comprising combining the estimated first relative likelihoods for the plurality of image windows; wherein the applying, the processing, the estimating, and the producing are performed using computer hardware.