System support for evaluation consistency

摘要

A system and computer product for validating the consistency between quantitative and natural language textual evaluations. An example method involves computing a numeric score for a textual evaluation, comparing the numeric score to a quantitative evaluation, and producing a rating based on the similarity of the two evaluations.

主权项

1. A system for validating the consistency between quantitative and natural language textual evaluations of an item, the system comprising:
a computer processor; receiving a quantitative evaluation of the item from an evaluator; receiving a natural language textual evaluation of the item from the evaluator; a computing module coupled to the computer processor configured to compute a numeric score for the natural language textual evaluation based on a textual analysis of the natural language textual evaluation; a comparing module coupled to the computer processor configured to determine the degree to which the numeric score and the quantitative evaluation are consistent with each other; a calculating module coupled to the computer processor configured to calculate a similarity rating from the comparison of the quantitative evaluation and the numeric score; and an alert module to display an alert in a user interface to the evaluator when an inconsistency between the numeric score and the quantitative evaluation is above a defined level.