Augmented reality (AR) audio with position and action triggered virtual sound effects

摘要

An augmented reality (AR) audio system for augmenting environment or ambient sound with sounds from a virtual speaker or sound source positioned at a location in the space surrounding an AR participant. The sound from the virtual speaker may be triggered by an action of the listener and/or by the location or relative orientation of the listener. The AR audio system includes stereo earphones receiving an augmented audio track from a control unit, and binaural microphones are provided to capture ambient sounds. The control unit operates to process trigger signals and retrieve one or more augmentation sounds. The control unit uses an AR audio mixer to combine the ambient sound from the microphones with the augmentation sounds to generate left and right ear augmented audio or binaural audio, which may be modified for acoustic effects of the environment including virtual objects in the environment or virtual characteristics of real objects.

主权项

1. A method for providing augmented audio to a listener wearing a headset including right and left ear speakers, comprising:
with binaural microphones on the headset, capturing ambient sound in an environment about the headset; from a sensor array worn or carried by the listener, receiving a trigger signal; with a track selection module, selecting an augmentation audio track in response to the trigger signal; with a processor running an augmented reality (AR) audio mixer, combining the captured ambient sound with the selected augmentation audio track to generate an AR audio output track; and playing the AR audio output track with the right and left ear speakers of the headset, wherein the selected augmentation audio track has binaural characteristics associated with a virtual speaker located relative to the listener's headset in the environment.