Information processing device capable of displaying a character representing a user, and information processing method thereof

摘要

The basic image specifying unit specifies the basic image of a character representing a user of the information processing device. The facial expression parameter generating unit converts the degree of the facial expression of the user to a numerical value. The model control unit determines an output model of the character for respective points of time. The moving image parameter generating unit generates a moving image parameter for generating animated moving image frames of the character for respective points of time. The command specifying unit specifies a command corresponding to the pattern of the facial expression of the user. The playback unit outputs an image based on the moving image parameter and the voice data received from the information processing device of the other user. The command executing unit executes a command based on the identification information of the command.

主权项

1. An information processing device comprising a computer processor operating under the control of one or more software programs such that the computer processor implements functions and actions, including:
an image data storage operative to store data on models of a character representing a user, the models including a plurality of facial expression models providing different facial expressions, and the plurality of facial expression models including a plurality of vocal models indicating statuses of a face when pronouncing different sounds; a facial expression parameter generating unit operative to calculate a degree of facial expression for each facial expression as a respective facial expression parameter by sequentially analyzing input moving image data acquired by capturing an image of the user, by deriving a numerical value representing a shape of a portion of a face for each of a plurality of input image frames, and by comparing the numerical value with a criteria value defined in advance; a model control unit operative to determine a weight for each of the plurality of facial expression models stored in the image data storage by using the facial expression parameter calculated by the facial expression parameter generating unit and a volume level obtained from voice data of the user acquired along with the capturing of the image, to synthesize the plurality of facial expression models according to the weights, to determine an output model of the character for points of time corresponding to each of the input image frames, and to synthesize the plurality of vocal models while changing the weights for the plurality of vocal models with different waveforms with time, wherein at least one of the facial expression parameters includes a degree of opening of a mouth and the model control unit is further operable to add the degree of opening of the mouth to at least one of the weights for the vocal models; a moving image parameter generating unit operative to generate a moving image parameter for generating animated moving image frames of the character including the output model determined by the model control unit for respective points of time; and an output unit operative to synchronize the moving image parameter generated by the moving image parameter generating unit and the voice data and to sequentially output.