Combined activation for natural user interface systems

摘要

A user interaction activation may be provided. A plurality of signals received from a user may be evaluated to determine whether the plurality of signals are associated with a visual display. If so, the plurality of signals may be translated into an agent action and a context associated with the visual display may be retrieved. The agent action may be performed according to the retrieved context and a result associated with the performed agent action may be displayed to the user.

主权项

1. A system for providing a user-interaction activation, the system comprising:
a display configured to display a multimedia presentation, the multimedia presentation comprising a series of frames that are displayed sequentially, each frame having a plurality of spatial areas, each spatial area having a context that comprises information relating to the multimedia presentation; at least one camera operatively coupled to the display; at least one microphone; a memory storage; and a processing unit coupled to the memory storage, the camera and the microphone, wherein the processing unit is operative to: receive, at the at least one microphone, a speech signal; analyze the speech signal to identify a request relating to the multimedia presentation, the request relating to a frame; receive, at the at least one camera, a gesture identifying a spatial area of the frame; create a query based on the request, the identified spatial area, and the context associated with the spatial area; perform the query; and display a result based on the performed query.