ROBOT AVATAR SYSTEM USING HYBRID INTERFACE AND COMMAND SERVER, LEARNING SERVER, AND SENSORY SERVER THEREFOR

摘要

Provided is a robot avatar system equipped with a hybrid interface including a brain computer interface (BCI), a head-mounted display (HMD) or smart glasses, a motion sensor, a position sensor, a microphone, a speaker, a tactile sensor, and a haptic actuator. The robot avatar system of the present invention comprises: an interface including the BCI, the HMD or the smart glasses, the motion sensor, the position sensor, the microphone, the speaker, the tactile sensor, and the haptic actuator; a command server which generates a command to control the behavior of the robot based on BCI information and motion information received therein from the BCI and the motion sensor or the position senor and outputs the voice information of a person received from the microphone through the robot; a BCI-motion learning server which constructs a BCI-motion mapping database and a label determination model used in the command server based on the BCI information and the motion information received therein from the BCI and the motion sensor or the position sensor; and a sensory server which processes audio, video, and tactile information, which are obtained through the robot, and outputs the processed information through the speaker, the HMD or the smart glasses, and the haptic actuator. [Reference numerals] (110) BCI device;(120) HMD/Smart glasses;(130) Vision sensor;(140,620) Microphone;(160) Position sensor;(200) Command server;(400) BCI-motion learning server;(500) Sensory server;(610) Camera;(640) Speaker;(650) Tactile sensor;(AA) Motion command, voice;(BB) BCI data, vision/position data, voice;(CC) Humanoid;(DD) Person;(EE) Raw sensory data;(FF) Processed sensory data