| 摘要 |
<p>A method of animating a computer generation of a head, the head having a mouth which moves in accordance with inputted speech or text to be output by the head, said method comprising: providing an input related to the speech which is to be output by the movement of the mouth, dividing said input into a sequence of acoustic units, selecting an expression to be output by said head and converting said sequence, of acoustic units to a sequence of image vectors using a statistical model. The model has a plurality of parameters describing probability distributions which relate an acoustic unit to an image vector for a selected expression, these image vector comprise a plurality of parameters which define a face of the head and the sequence of image vectors is output as video such that the mouth of said head moves to mime the speech associated with the input text with the selected expression. The head is defined using an appearance model comprising a plurality of shape modes and a corresponding plurality of appearance modes, wherein the shape modes define a mesh of vertices which represents points of the face of said head and the appearance modes represent colours of pixels of the said face, the face being generated by combining a weighted sum of shape modes and a weighted sum of appearance modes, the weighting being provided by a number of image parameters. Also disclosed as additional inventions are means for rendering a computer generated head based on a combination of shape and appearance modes and a means for training a model to produce a computer generated head.</p> |
