MULTIMODAL COMPUTER NAVIGATION

摘要

This invention concerns multimodal computer navigation, that is operation of a computer using traditional modes such as keyboard together with less conventional modes such as speech and gestures. The invention has particular application for navigation of information presentations, such as webpages and database user interfaces, and is presented as a method, a browser, software and a computer system. The information navigated is not described in a multimodal way. Two or more unimodal navigation signals are received from a user and interpreted. These interpretations are fused to automatically determining the user's intended navigation selection.