PRESENTING SUPPLEMENTAL CONTENT FOR DIGITAL MEDIA USING A MULTIMODAL APPLICATION

摘要

A method for presenting supplemental content for digital media using a multimodal application, implemented with a grammar of the multimodal application in an automatic speech recognition ( 'ASR' ) engine, with the multimodal application operating on a multimodaldevice supporting multiple modes of interaction including a voice mode and one or more non-voice modes, the multimodal application operatively coupled to the ASR engine, the method including: rendering, by the multimodalapplication, a portion of the digitalmedia; receiving, by the multimodal application, a voice utterance from a user; determining, by the multimodal application using the ASR engine, a recognition result in dependence upon the voice utterance and the grammar; identifying, by the multimodal application, supplemental content for the rendered portion of the digital media in dependence upon the recognition result; and rendering, by the multimodalapplication, the supplemental content.