System and Method for Using Speech for Data Searching During Presentations

摘要

There is provided for a system, method, and computer readable medium storing instructions related to controlling a presentation in a multimodal system. A method for the retrieval of information on the basis of its content for real-time incorporation into an electronic presentation is discussed. One method includes controlling a media presentation using a multimodal interface. The method involves receiving from a presenter a content-based request associated with a plurality of segments within a media presentation preprocessed for context-based searching; displaying the media presentation and displaying to the presenter results in response to the content-based request; receiving a selection from the presenter of at least one result; and displaying the selected result to an audience.

主权项

1. A method comprising:
transmitting, from a first device having a processor and a first display, a current segment of a media presentation to a second device, the second device having a second display; receiving, at the first device, a spoken query to search a plurality of segments within the media presentation; displaying, via the first device, the current segment of the media presentation and a search result set in response to the spoken query, the search result set comprising a portion of the plurality of segments which is associated with the spoken query, the search result set being displayed on the first device and not on the second device; receiving, via motion input, a selection from the search result set, to yield a selected segment; and transmitting the selected segment to the second display device for display.