| 摘要 |
PROBLEM TO BE SOLVED: To provide a mouth shape detector that is suitable to detect the mouth shape of a speaker and has high flexibility, in order to recognize speech intention and a word spoken under noise conditions, etc., and to provide a word recognizing device that recognizes the spoken words from the change of the shape of the mouth. SOLUTION: The color information of pixels, obtained by photographing the face of the speaker in color, is compared with the normalized color information of a face region acquired in advance, and photographed data are divided into regions of flesh, lips, mouth and teeth. The inner circumferential outline of the lips is calculated, by combining the acquired mouth and teeth areas to detect the mouth shape. The changing lip parts of the speaker which brings out the word is also photographed in color to obtain a moving image string, the response characteristic of the spoken word is compared with the response characteristic of a word registered in a dictionary in advance, by using the time response characteristic of a ratio in which an inherent image calculated by an eigenspace method, is included in an acquired lips image, and the spoken word is recognized by identifying similar words. |
