发明名称 |
Systems and Methods for Evaluating Susceptibility of Automated Scoring Engines to Gaming Behavior |
摘要 |
Systems and methods are provided for determining a susceptibility of a computer-implemented automated scoring engine to gaming strategies. A plurality of responses to a prompt are provided to a computer-implemented automated scoring engine to receive a first set of scores. A first transformation is performed on each of the plurality of responses to generate a first set of transformed responses. The first set of transformed responses is provided to the computer-implemented automatic scoring engine to receive a second set of scores, and a gaming susceptibility metric is determined based on the first set of scores and the second set of scores. |
申请公布号 |
US2014295399(A1) |
申请公布日期 |
2014.10.02 |
申请号 |
US201414226318 |
申请日期 |
2014.03.26 |
申请人 |
Educational Testing Service |
发明人 |
Higgins Derrick;Bejar Isaac;Heilman Michael;Futagi Yoko;Flor Michael |
分类号 |
G09B7/06 |
主分类号 |
G09B7/06 |
代理机构 |
|
代理人 |
|
主权项 |
1. A computer-implemented method of determining a susceptibility of an automated scoring engine to gaming strategies, comprising:
providing a plurality of responses to a prompt to a computer-implemented automated scoring engine to receive a first set of scores; performing a first transformation on each of the plurality of responses to generate a first set of transformed responses; providing the first set of transformed responses to the computer-implemented automatic scoring engine to receive a second set of scores; and determining a gaming susceptibility metric based on the first set of scores and the second set of scores. |
地址 |
Princeton NJ US |