| 摘要 |
Systems and methods are provided for distributing constructed responses to scorers to score while reducing an undesirable statistical metric. A constructed response scoring plan is generated, where the scoring plan includes distributing a plurality of constructed responses to scorers for scoring, and where a scoring effectiveness metric is calculated for the scoring plan. An undesirable statistical aspect is identified that has a negative effect on the scoring effectiveness metric. A distribution rule is generated that will reduce the effect of the undesirable statistical aspect on the scoring effectiveness metric. A constructed response queue is generated for a particular scorer based on the distribution rule, and a next constructed response is provided from the constructed response queue to the particular scorer for scoring.
|
