Audio and amplitude modulated photo data collection for speech recognition

摘要

A speech recognition data collection arrangement in which audio sounds spoken by the user are supplemented with lip and mouth movement information obtained from a combination of a light emitting diode and photodiode disposed immediately before the user's face is disclosed. The lip and mouth movement photo information is obtained in the form of an AC coupled amplitude modulated carrier waveform which results from energization of the light emitting diode from a pulsating or alternating current component inclusive source of electrical energy. The lip and mouth movement amplitude modulated carrier waveform is processed with filtering and envelope detection and communicated to a programmed digital computer for the purpose of dual-channel audio and photo based accomplishment of human speech recognition.