Interactive user interface for an intelligent assistant

摘要

A system, method and computer program for performing voice commands on a mobile device and presenting the results on an interactive timeline is disclosed. A user may utter a voice command into the microphone of their mobile device while an application is running. The voice command is processed to derive the intention of the user, specifically by determining the domain, at least one task and at least one parameter for the task from the voice command. A services component performs the task identified and presents the results on the mobile device screen. In various embodiments, the results are presented on a timeline and may be grouped together by domains and sorted by the time that the results were obtained. A search history view may also be viewed that includes search results sorted chronologically each of which is represented graphically by an icon that represents the category of each search. When a user utters a voice command, the text representation is displayed together with an edit button, a resay button, and a progress bar. A user may modify the text representation at any time while the natural language processing is being performed.

主权项

1. A computer-implemented method for making a voice input to a computing device, the voice input for instructing the computing device to perform at least one task, the method being performed by one or more processors of the computing device and comprising:
receiving at the computing device one or more user inputs to display a voice input interface; displaying the voice input interface; receiving the voice input at the voice input interface; providing the voice input to an automatic speech recognition engine for processing the voice input and producing a text representation of the voice input; displaying the text representation of the voice input on the voice input interface, wherein the voice input interface is configured to process the text representation and further configured to allow a user to modify the text representation before a results screen is displayed to the user; and displaying a progress representation on the voice input interface, wherein the voice input interface is configured to allow the user to modify the text representation to generate a modified text representation after processing, and wherein processing the modified text representation includes performing natural language processing on the modified text representation to identify at least one domain, the at least one task, and at least one parameter to which the modified text representation relates.