Interactive content creation

摘要

An audio/visual system (e.g., such as an entertainment console or other computing device) plays a base audio track, such as a portion of a pre-recorded song or notes from one or more instruments. Using a depth camera or other sensor, the system automatically detects that a user (or a portion of the user) enters a first collision volume of a plurality of collision volumes. Each collision volume of the plurality of collision volumes is associated with a different audio stem. In one example, an audio stem is a sound from a subset of instruments playing a song, a portion of a vocal track for a song, or notes from one or more instruments. In response to automatically detecting that the user (or a portion of the user) entered the first collision volume, the appropriate audio stem associated with the first collision volume is added to the base audio track or removed from the base audio track.

主权项

1. A method for audio content creation, comprising:
defining a plurality of three-dimensional collision volumes, the plurality of three-dimensional collision zones being at least partially different three-dimensional spaces; assigning a base track of music to each of the plurality of three-dimensional collision volumes; playing audio content; automatically tracking movement of a user, including automatically detecting predefined motion of the user in one or more of the plurality of collision volumes; and automatically changing the audio content upon entry of a body part into one or more of the collision volumes, the change in the audio content being based on which collision volume or volumes are entered by a body part and what predefined motions are performed within the one or more collision volumes.