发明名称 Method, system, and program product for measuring audio video synchronization using lip and teeth characteristics
摘要 Method, system, and program product for measuring audio video synchronization. This is done by first acquiring audio video information into an audio video synchronization system. The step of data acquisition is followed by analyzing the audio information, and analyzing the video information. Next, the audio information is analyzed to locate the presence of sounds therein related to a speaker's personal voice characteristics. In Analysis Phase Audio and Video MuEv-s are calculated from the audio and video information, and the audio and video information is classified into vowel sounds including AA, EE, OO, B, V, TH, F, silence, other sounds, and unclassified phonemes. The inner space between the lips are also identified and determined. This information is used to determine and associate a dominant audio class in a video frame. Matching locations are determined, and the offset of video and audio is determined.
申请公布号 US2007153089(A1) 申请公布日期 2007.07.05
申请号 US20060598870 申请日期 2006.11.13
申请人 PIXEL INSTRUMENTS, CORP. 发明人 COOPER J. C.;VOJNOVIC MIRKO D.;ROY JIBANANANDA;JAIN SAURABH;SMITH CHRISTOPHER
分类号 H04N17/02;G06K9/00;G06K9/46;H04N5/04;H04N7/01;H04N7/08;H04N7/52;H04N9/475;H04N17/00 主分类号 H04N17/02
代理机构 代理人
主权项
地址