发明名称 System and method for validating natural language content using crowdsourced validation jobs
摘要 Systems and methods of validating transcriptions of natural language content using crowdsourced validation jobs are provided herein. In various implementations, a transcription pair comprising natural language content and text corresponding to a transcription of the natural language content may be gathered. A first group of validation devices may be selected for reviewing the transcription pair. A first crowdsourced validation job may be created for the first group of validation devices. The first crowdsourced validation job may be provided to the first group of validation devices. A vote representing whether or not the text accurately represents the natural language content may be received from each of the first group of validation devices. A validation score may be assigned to the transcription pair based, at least in part, on the votes from each of the first group of validation devices.
申请公布号 US9401142(B1) 申请公布日期 2016.07.26
申请号 US201514846935 申请日期 2015.09.07
申请人 VoiceBox Technologies Corporation 发明人 Rothwell Spencer John;Braga Daniela;Elshenawy Ahmad Khamis;Carter Stephen Steele
分类号 G10L15/01;G06F17/28;G10L15/18;G10L15/26 主分类号 G10L15/01
代理机构 Sheppard Mullin Richter & Hampton LLP 代理人 Sheppard Mullin Richter & Hampton LLP
主权项 1. A computer-implemented method, the method being implemented in a computer system having one or more physical processors programmed with computer program instructions that, when executed by the one or more physical processors, program the computer system to perform the method, the method comprising: obtaining, by the computer system, a transcription pair comprising natural language content and text, wherein the natural language content comprises audio content received from one or more audio input components, and wherein the text corresponds to a transcription of the natural language content; creating, by the computer system, a first crowdsourced validation job to be performed at one or more first validation devices, the first crowdsourced validation job providing the one or more first validation devices with first instructions for a crowd user to provide a determination of whether or not the text is an accurate transcription of the natural language content; causing, by the computer system, the first crowdsourced validation job to be provided to the one or more first validation devices; receiving, by the computer system, from each of the one or more first validation devices, a vote representing the determination of whether or not the text is an accurate transcription of the natural language content; assigning, by the computer system, a validation score to the transcription pair based, at least in part, on votes received from the one or more first validation devices with respect to the transcription pair; determining, by the computer system, whether or not the one or more first validation devices agreed the text is an accurate transcription of the natural language content; and determining, by the computer system, whether to provide the transcription pair to one or more second validation devices.
地址 Bellevue WA US