| 摘要 |
A system, apparatus, and method for generating a spatial user interface for an application, system or device. The user interface includes a means of representing user interface functions or commands as audio signals, with the audio signals being perceived by the user in a spatially different location depending on the function or command. A user input device is provided to enable a user to select a function or command, or to navigate through the spatial representations of the audio signals. |
| 主权项 |
1. A system, comprising:
a spatial model generator including a spatial input decoder in communication with a spatial model manager and operative to receive input data associated with a user interface element, and to generate output data defining a spatial location at which a user will perceive an audio signal corresponding to the user interface element, the user interface element including a multi-dimensional spatial model that determines the spatial location; a spatial audio effects processor in communication with the spatial model manager, the spatial audio effects processor operative to receive as an input an audio input and to generate the audio signal as an output comprised of multiple channels generated from a plurality of streams, a first portion of the plurality of streams comprising a voice stream, the spatial audio effects processor being configured to mix a second portion of the plurality of streams to form a second channel stream, to mix a third portion of the plurality of streams to form a third channel stream, to determine a strength of volume between the second channel stream and the third channel stream using the multi-dimensional spatial model, each channel modified relative to other channels according to its distance from an origin of the multi-dimensional spatial model, its angle in the multi-dimensional spatial model or both, the audio signal representing the processed audio input as perceived by the user at the spatial location; an application system in communication with the spatial audio effects processor and the spatial model manager, the application system being configured to provide user interface element information to the spatial model manager, the spatial audio effects processor being configured to communicate data corresponding to user interface elements to and from the application system; and an input device electrically coupled with the spatial input decoder, the input device including a plurality of 3-dimensional accelerometers, the input device operative to select the audio signal or to alter a spatial arrangement of the audio signal that is perceived by the user, and the arrangement of the audio signal including a selected one or more of transforming, changing, rotating, restoring, navigating, or translating the multi-dimensional spatial model in a plurality of dimensions. |
