System and method for digital video retrieval involving speech recognition

摘要

Disclosed are systems, methods, and computer readable media for retrieving digital images. The method embodiment includes converting a descriptive audio stream of a digital video that is provided for the visually impaired to text and then aligning that text to the appropriate segment of the digital video. The system then indexes the converted text from the descriptive audio stream with the text's relationship to the digital video. The system enables queries using action words describing a desired scene from a digital video.

主权项

1. A method comprising:
converting a descriptive audio stream associated with a digital video to text; performing a non-textual optical analysis of a frame on the digital video, to yield an analysis; and aligning the text to frames in the digital video based on the analysis, a first bit rate associated with the digital video, and a second bit rate associated with the descriptive audio stream.