Method For Finding Elements In A Webpage Suitable For Use In A Voice User Interface

摘要

A voice interface for web pages or other documents identifies interactive elements such as links, obtains one or more phrases of each interactive element, such as link text, title text and alternative text for images, and adds the phrases to a grammar which is used for speech recognition. A click event is generated for an interactive element having a phrase which is a best match for the voice command of a user. In one aspect, the phrases of currently-displayed elements of the document are used for speech recognition. In another aspect, phrases which are not displayed, such as title text and alternative text for images, are used in the grammar. In another aspect, updates to the document are detected and the grammar is updated accordingly so that the grammar is synchronized with the current state of the document.

主权项

1. A method for providing a voice user interface, comprising:
analyzing a document to identify an interactive element in the document, the interactive element comprises one or more phrases; rendering the document to provide a display on a display device, the rendering comprises determining that the interactive element is currently within a display region of the display device; including the one or more phrases with candidate phrases responsive to the determining that the interactive element is currently within the display region of the display device; comparing a voice command of a user to the candidate phrases; and based on the evaluating, determining that the one or more phrases is a best match for the voice command of the user and, in response, generating a click event for the interactive element.