APPARATUS AND METHOD FOR RECOGNIZING INSTRUCTION USING VOICE AND GESTURE

摘要

An apparatus and method that recognizes an instruction using voice and gesture to decrease time spent recognizing a sound model and a language model by recognizing the initial sound of each syllable of instructions using a gesture recognition technology and recognizing the voice for the instruction based on the recognized initial sound of each syllable.

主权项

1. An apparatus that recognizes an instruction using voice and gesture, the apparatus comprising:
a controller configured to:
receive a captured gesture of a user;recognize an initial sound corresponding to the captured gesture;receive a voice instruction from the user;analyze the received voice instruction and determine a candidate instruction;compare the recognized initial sound with the determined candidate instruction and calculate a similarity therebetween; anddetermine the candidate instruction having a greatest similarity as a final instruction.