METHOD FOR LANGUAGE MODEL EVALUATION, DEVICE FOR THE SAME AND PROGRAM

摘要

PROBLEM TO BE SOLVED: To provide a method for language model evaluation and a device for the same that make it possible to quantitatively grasp an effect in additional learning of a language model.SOLUTION: A language model evaluation device 100 comprises: a language model part 10 that stores a word chain consisting of two or more words obtained from a written text and also stores its appearance probability; a comparison part 20 that compares the word chain which is stored in the language model part 10 and consists of two or more words obtained from the written text with a word chain in an additional written text to be input externally, and outputs storage information showing whether or not the word chain is already stored in the language model part 10; and an evaluation part 30 that calculates a non-observed word string proportion which is a proportion of a word chain not stored in the language model part 10 to the word chain in the additional written text, on the basis of the storage information.