发明名称 |
SYSTEM AND METHOD FOR CONTINUOUS MULTIMODAL SPEECH AND GESTURE INTERACTION |
摘要 |
<p>Disclosed herein are systems, methods, and non-transitory computer-readable storage media for processing multimodal input. A system configured to practice the method continuously monitors an audio stream associated with a gesture input stream, and detects a speech event in the audio stream. Then the system identifies a temporal window associated with a time of the speech event, and analyzes data from the gesture input stream within the temporal window to identify a gesture event. The system processes the speech event and the gesture event to produce a multimodal command. The gesture in the gesture input stream can be directed to a display, but is remote from the display. The system can analyze the data from the gesture input stream by calculating an average of gesture coordinates within the temporal window.</p> |
申请公布号 |
WO2013082435(A1) |
申请公布日期 |
2013.06.06 |
申请号 |
WO2012US67309 |
申请日期 |
2012.11.30 |
申请人 |
AT&T INTELLECTUAL PROPERTY I, L.P.;JOHNSTON, MICHAEL;OZKAN, DERYA |
发明人 |
JOHNSTON, MICHAEL;OZKAN, DERYA |
分类号 |
G06F3/16;G06F3/01;G06F3/0488 |
主分类号 |
G06F3/16 |
代理机构 |
|
代理人 |
|
主权项 |
|
地址 |
|