APPARATUS AND METHOD FOR CONTROLLING MULTI MODAL HUMAN-MACHINE INTERFACE

摘要

Provided are an apparatus and a method for controlling a multi-modal HMI, which generate a multi-modal control signal based on voice information on the voice of a user and gesture information on the gesture of the user, select one among at least one object recognized in the direction of the gaze of the user using the multi-modal control signal, and display object-related information on the selected object according to the multi-modal control signal.