METHOD AND DEVICE FOR RECOGNIZING HUMAN EMOTION FROM A VIDEO STREAM

摘要

The present invention discloses a method and device for recognizing human emotion from a video stream. The method comprises detecting face in the video stream, aligning a plurality of fiducial points on the detected face, detecting emotion state of the face by analyzing an appearance change in the face of the video stream with respect to an initial neutral frame of the video stream, predicting action units based on the detected emotion state of the face and recognizing the human emotion based on the predicted one or more action units. The predicting action units based on the detected emotion state incudes predicting one or more AU based on an extracted plurality of appearance based features, predicting one or more action units by detecting geometrical change infacial part using the fiducial point and predicting one or more action units by detecting change in appearance based features in face. Figure 3