| 发明名称 |
Non-scorable response filters for speech scoring systems |
| 摘要 |
A method for scoring non-native speech includes receiving a speech sample spoken by a non-native speaker and performing automatic speech recognition and metric extraction on the speech sample to generate a transcript of the speech sample and a speech metric associated with the speech sample. The method further includes determining whether the speech sample is scorable or non-scorable based upon the transcript and speech metric, where the determination is based on an audio quality of the speech sample, an amount of speech of the speech sample, a degree to which the speech sample is off-topic, whether the speech sample includes speech from an incorrect language, or whether the speech sample includes plagiarized material. When the sample is determined to be non-scorable, an indication of non-scorability is associated with the speech sample. When the sample is determined to be scorable, the sample is provided to a scoring model for scoring. |
| 申请公布号 |
US8990082(B2) |
申请公布日期 |
2015.03.24 |
| 申请号 |
US201213428448 |
申请日期 |
2012.03.23 |
| 申请人 |
Educational Testing Service |
发明人 |
Yoon Su-Youn;Higgins Derrick;Zechner Klaus;Xie Shasha;Jeon Je Hun;Evanini Keelan |
| 分类号 |
G10L15/00;G09B19/06;G10L25/60;G10L15/26;G10L25/78;G10L25/90 |
主分类号 |
G10L15/00 |
| 代理机构 |
|
代理人 |
Day Jones |
| 主权项 |
1. A computer-implemented method of scoring non-native speech, comprising:
receiving a speech sample spoken by a non-native speaker; performing automatic speech recognition on the speech sample to generate a transcript of the speech sample; processing the speech sample to generate a plurality of speech metrics associated with the speech sample; applying a plurality of non-scorable response filters to the plurality of speech metrics; determining whether the speech sample is scorable or non-scorable based upon the transcript and a collective application of said non-scorable response filters, wherein said determining is based on assessment of audio quality of the speech sample, an amount of speech of the speech sample, a degree to which the speech sample is off-topic, and whether the speech sample includes speech from an incorrect language; associating an indication of non-scorability with the speech sample when the sample is determined to be non-scorable; and providing the sample to a scoring model for scoring when the sample is determined to be scorable. |
| 地址 |
Princeton NJ US |
