THE SPEECH RECOGNITION METHOD AND APPARATUS USING MULTIMODAL

摘要

A multimodal voice recognition method and an apparatus thereof are provided to ensure a high success rate of voice recognition even in a low-spec portable terminal as well as a high performance computing device by performing voice recognition based on a multimodal synchronized consonant and a user's voice. A multimodal voice recognition method comprises the following steps of: receiving a consonant from a user and receiving a user's voice, and synchronizing the consonant and the user's voice(300,301); extracting vocabularies, started from the synchronized consonant, from a pronunciation dictionary(302); creating the extracted vocabularies as a voice recognition dictionary(303); and searching a corresponding vocabulary from the created voice recognition dictionary and recognizing a word or a sentence corresponding to the user's voice(304).