摘要 |
A method, including receiving multi-labeler data that includes data points labeled by a plurality of labelers; building a model from the multi-labeler data, wherein the model includes an input variable that corresponds to the data points, a label variable that corresponds to true labels for the data points, and variables for the labels given by the labelers; and executing the model, in response to receiving new data points, to determine a level of expertise of the labelers for the new data points.
|