SYSTEM AND METHOD FOR TRAINING A CLASSIFIER FOR NATURAL LANGUAGE UNDERSTANDING

摘要

Disclosed herein are systems, methods, and computer-readable storage devices for building classifiers in a semi-supervised or unsupervised way. An example system implementing the method can receive a human-generated map which identifies categories of transcriptions. Then the system can receive a set of machine transcriptions. The system can process each machine transcription in the set of machine transcriptions via a set of natural language understanding classifiers, to yield a machine map, the machine map including a set of classifications and a classification score for each machine transcription in the set of machine transcriptions. Then the system can generate silver annotated data by combining the human-generated map and the machine map. The algorithm can include different branches for when the machine transcription is available, when partial results are available, when no results are found for the machine transcription, and so forth.

主权项

1. A method comprising:
receiving a map which identifies categories of human transcribed utterances; receiving a plurality of machine generated transcriptions; processing each machine transcription in the plurality of machine transcriptions via a plurality of natural language understanding classifiers, to yield a machine map, the machine map comprising a plurality of classifications and a classification score for each machine transcription in the plurality of machine transcriptions; and generating, via a processor, silver annotated data by combining the map and the machine map.