System and method for using speech for data searching during presentations

摘要

There is provided for a system, method, and computer readable medium storing instructions related to controlling a presentation in a multimodal system. A method for the retrieval of information on the basis of its content for real-time incorporation into an electronic presentation is discussed. One method includes controlling a media presentation using a multimodal interface. The method involves receiving from a presenter a content-based request associated with a plurality of segments within a media presentation preprocessed for context-based searching; displaying the media presentation and displaying to the presenter results in response to the content-based request; receiving a selection from the presenter of at least one result; and displaying the selected result to an audience.

主权项

1. A method comprising:
transmitting, from a first device having a processor and a first display, a current segment of a media presentation to a second device, the second device having a second display; receiving, at the first device, a spoken query to search a plurality of segments within the media presentation; displaying, on the first display of the first device, the current segment of the media presentation and a search result set in response to the spoken query, the search result set comprising a portion of the plurality of segments, the search result set not being transmitted to the second device; receiving, via motion input from a user, a selection from the search result set, to yield a selected segment; and transmitting the selected segment to the second device for display, the selected segment replacing the current segment being displayed on the second display of the second device.