Method of performing multi-modal dialogue between a humanoid robot and user, computer program product and humanoid robot for implementing said method

摘要

A method of performing a dialogue between a humanoid robot (R) and at least one user (U) comprising the following steps, carried out iteratively by said humanoid robot: i) acquiring a plurality of input signals (s1, s2) from respective sensors (c1, c2), at least one said sensor being a sound sensor and at least one other sensor being a motion or image sensor; ii) interpreting the acquired signals to recognize a plurality of events (EVI) generated by said user, selected from a group comprising: the utterance of at least a word or sentence, an intonation of voice, a gesture, a body posture, a facial expression; iii) determining a response of said humanoid robot, comprising at least one event (EVO) selected from a group comprising: the utterance of at least a word or sentence, an intonation of voice, a gesture, a body posture, a facial expression; iv ) generating, by said humanoid robot, said or each said event; characterized in that said step iii) comprises determining said response as a function of at least two events jointly generated by said user and recognized at said step ii), of which at least one is not a word or sentence uttered by said user. A computer program product and a humanoid robot for carrying out such a method.