Sound to haptic effect conversion system using mapping

摘要

A haptic conversion system is provided that intercepts audio data, such as a digital audio signal, analyzes the audio data in frequency, and divides the analyzed audio data into one or more audio frequency regions, where each audio frequency region includes one or more audio sub-signals. The haptic conversion system further maps the one or more audio frequency regions to one or more haptic frequency regions, where each haptic frequency region includes one or more haptic signals. The haptic conversion system further maps the one or more haptic effects to one or more actuators. The haptic conversion system further sends the one or more haptic signals to one or more actuators, in order to generate one or more haptic effects.

主权项

1. A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to convert an audio signal into one or more haptic effects, the converting comprising:
pre-processing the audio signal by modifying the audio signal to create a modified audio signal and adjusting one or more parameters used to generate one or more haptic frequency regions based on a measurement of the modified audio signal, wherein the adjusting configures the one or more parameters to enable haptic feedback for foreground events and reduce or mute haptic feedback for background events; dividing the modified audio signal into a plurality of audio frequency regions that each comprise one or more audio sub-signals with frequencies within a corresponding audio frequency range; generating the one or more haptic frequency regions based on the one or more parameters, wherein each of the one or more haptic frequency regions comprises one or more haptic signals with frequencies within a corresponding haptic frequency region; mapping each of the plurality of audio frequency regions to at least one corresponding haptic frequency region in the one or more haptic frequency regions, wherein each audio frequency range is mapped to a plurality of corresponding haptic frequency ranges; and sending the one or more haptic signals to an actuator to generate the one or more haptic effects.