Latency hiding techniques for multi-modal user interfaces

摘要

A multi-modal user interface is described that hides response latency delays. A graphical user interface (GUI) supports different user input modalities including low delay inputs which respond to user inputs without significant delay, and high latency inputs which have a significant response latency after receiving a user input before providing a corresponding completed response. The GUI accepts user inputs in a sequence of mixed input modalities independently of response latencies without waiting for responses to high latency inputs, and responds to each user input in the sequence as if each preceding user input in the sequence had been performed without response latencies.

主权项

1. A computer system for displaying a multi-modal user interface comprising:
a display; and a processor configured to display on the display a graphical user interface (GUI) supporting a plurality of different user input modalities including: i. one or more low delay input modalities, each of which responds to a low delay user input with a low delay, and ii. one or more high latency input modalities, each of which has a high response latency after receiving a high latency user input before providing a completed response to the high latency user input; wherein the computer system is configured to: accept, via the GUI, low delay and high latency user inputs in a sequence of mixed input modalities independently of response latencies without waiting for responses to high latency inputs as if each preceding user input in the sequence had been performed without response latencies; after receiving a first high latency user input followed by a subsequent low delay user input in the sequence of mixed input modalities, alter an appearance of a display corresponding to the low delay user input to indicate a possible change in a final result for the subsequent low delay user input pending a response from the first high latency user input; and accept user input for a second high latency input modality prior to providing a completed response to the first high latency user input.