摘要 |
Systems and methods for evaluating a worker in performing crowd sourced tasks and providing in-task training are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for selecting a job distributed through a job distribution platform for workers to work on, for use to generate a test task, the job being associated with a known correct result, associating a manipulated result, known to be an incorrect result for the job, with the job to generate the test task, and/or presenting the job with the manipulated result as the test task to a worker for evaluation of work quality of the worker. The job distribution platform crowd sources tasks online to workers to work on via their respective computing devices. |
申请人 |
CROWDFLOWER, INC.;OLESON, DAVID;SOROKIN, ALEXANDER;LAUGHLIN, GREG;HESTER, VAUGHN;LE, JOHN;VAN PELT, CHRISTOPHER, R.;BIEWALD, LUKAS, A. |
发明人 |
OLESON, DAVID;SOROKIN, ALEXANDER;LAUGHLIN, GREG;HESTER, VAUGHN;LE, JOHN;VAN PELT, CHRISTOPHER, R.;BIEWALD, LUKAS, A. |