Ambient noise based augmentation of media playback

摘要

Ambient noise sampled by a mobile device from a local environment is used to automatically trigger actions associated with content currently playing on the mobile device. In some implementations, subtitles or closed captions associated with the currently playing content are automatically invoked and displayed on a user interface based on a level of ambient noise. In some implementations, audio associated with the currently playing content is adjusted or muted. Actions can be automatically triggered based on a comparison of the sampled ambient noise, or an audio fingerprint of the sampled ambient noise, with reference data, such as a reference volume level or a reference audio fingerprint. In some implementations, a reference volume level can be learned on the mobile device based on ambient noise samples.

主权项

1. A method performed by a mobile device comprising:
playing audio content by the mobile device; sampling ambient noise by the mobile device from a local environment of the mobile device to obtain a sample of the ambient noise, the ambient noise interfering with the played audio content; converting the sampled ambient noise to an audio fingerprint; comparing the audio fingerprint to other ambient noise audio fingerprints previously stored at the mobile device, each stored ambient noise audio fingerprint previously created by the mobile device by:
sampling a respective ambient noise by the mobile device from a respective local environment while playing audio content, andconverting the respective ambient noise to the each stored ambient noise audio fingerprint; when a match is identified, retrieving an action item from a table of actions associated with the stored ambient noise audio fingerprints; and performing a function of a graphical user interface control of the mobile device as determined by the action item.