Method and system for assigning a task to be processed by a crowdsourcing platform

摘要

A method and system for applying a task to a crowdsourcing platform for processing are disclosed. For example, a method forwards the task having a question to the crowdsourcing platform, and receives a plurality of answers to the question, wherein the plurality of answers is provided by a plurality of workers associated with the crowdsourcing platform. The method analyzes the plurality of answers on a per-worker basis to determine an adjustment, and applies the adjustment to the plurality of answers.

主权项

1. A method for applying a task to a crowdsourcing platform for processing, comprising:
forwarding, with a first computing system, the task having a question to the crowdsourcing platform, the task comprising a human intelligence task associated with an identified compensation per human intelligence task, wherein a correct answer to the question is not pre-identified by the first computing system before the forwarding; receiving a plurality of answers to the question, wherein the plurality of answers is provided by a plurality of workers associated with the crowdsourcing platform; analyzing, with the first computing system, the plurality of answers on a per-worker basis to identify one or more indications of accuracy of one or more answers of the plurality of answers and to determine an adjustment at least partially based on the one or more indications of accuracy of one or more answers of the plurality of answers, wherein the analyzing comprises determining one or more relations of one or more answers of the plurality of answers to one or more subsets of answers of the plurality of answers, wherein the adjustment is based at least in part on the one or more relations and an entropy characterization of the plurality of answers; and applying the adjustment to one or more of the plurality of answers.