SYSTEM FOR OBJECT LEARNING THROUGH MULTI-MODAL INTERACTION AND METHOD THEREOF

摘要

PURPOSE: An object learning system of a robot using multi-modal interaction and method thereof are provided to enable a user to teach object information to the robot by enabling a user to communicate with the robot through the multi-modal interaction. CONSTITUTION: An object extraction means(122) extracts a video from objects. An interaction unit performs interaction with a user. A robot learns the object using object information in which is collected from the interaction means and the object information in which is extracted from the object extraction means. A gesture recognition means(120) recognizes the gesture of a user in the video. The robot learns the object using the object information collected from the gesture recognition means and the interaction means.