LIPREADING AND VOICE RECOGNITION COMBINATION MULTIMODAL INTERFACE SYSTEM

摘要

PURPOSE: A multimodal interface system combining a lip reading and a voice recognition is provided to perform a service in an environment in which the voice recognition is not available by combining the lip reading and with the voice recognition. CONSTITUTION: A lip image input unit(140) receives the lip image through an image sensor or other external input. A lip reading unit(150) processes the inputted image, and recognize the lip reading command of a user. A lip reading recognition command output unit(160) outputs the recognized lip reading command. A voice and lip reading recognition result combiner(170) outputs a command by the comparison result between the estimation probability and the threshold value.