TRANSLATION AND INTEGRATION OF PRESENTATION MATERIALS IN CROSS-LINGUAL LECTURE SUPPORT

摘要

Computer-based systems and methods are disclosed for translation of a spoken presentation (e.g., a lecture) along with the accompanying presentation materials. Translation and delivery of the presentation materials to a listener is annotated and aligned with the lecture, so that the listener can follow both the lecture and the presentation material. The content of the presentation materials can be used to improve lecture translation and transcription, as it extracts supportive material from the presentation materials as they relate to the lecturer's speech.

主权项

1. A method comprising:
recognizing speech by a speaker in a first language; translating, by a translation system, the recognized speech into a second language; receiving presentation materials presented with the speech in the first language; extracting a portion of text in the first language from the presentation materials; generating a third marker at a time associated with a portion of the presentation materials; translating, by a translation system, the extracted text into the second language; generating a translation of the presentation materials in the second language based on the text in the second language; and aligning the speech in the second language and the translated presentation materials.