Systems and methods for creating animations using human faces

摘要

Systems and methods in accordance with embodiments of the invention enable collaborative creation, transmission, sharing, non-linear exploration, and modification of animated video messages. One embodiment includes a video camera, a processor, a network interface, and storage containing an animated message application, and a 3D character model. In addition, the animated message application configures the processor to: capture a video sequence using the video camera; detect a human face within a sequence of video frames; track changes in human facial expression of a human face detected within a sequence of video frames; map tracked changes in human facial expression to motion data, where the motion data is generated to animate the 3D character model; apply motion data to animate the 3D character model; render an animation of the 3D character model into a file as encoded video; and transmit the encoded video to a remote device via the network interface.

主权项

1. A computer-implemented method for generating animations messages using video images of human faces, the method comprising:
receiving a sequence of video frames; detecting a human face within the sequence of the video frames; tracking, within the sequence of video frames, facial expression changes in the detected human face; identifying, for each of the tracked facial expression changes, a facial expression from a training set of a plurality of different facial expressions and a plurality of different user faces that most closely corresponds to the tracked facial expression change; mapping, by at least one processor, each of the identified facial expressions to three-dimensional motion data such that the identified facial expressions corresponds with the tracked facial expression changes from the sequence of video frames; and applying the three-dimensional motion data to a three-dimensional character model to animate a face of the three-dimensional character model.