Language model adaptation based on filtered data

摘要

A method for adapting a language model for a context of a domain, comprising obtaining textual contents from a large source by a request directed to the context of the domain, discarding at least a part of the textual contents that contain textual terms determined as irrelevant to the context of the domain, thereby retaining, as retained data, at least a part of the textual contents that contain textual terms determined as relevant to the context of the domain, and adapting the language model by incorporating therein at least a part of the textual terms of the retained data, wherein the method is performed on an at least one computerized apparatus configured to perform the method and equipped for communication with the large source, and an apparatus for performing the same.

主权项

1. A method for adapting a language model for a context of a domain, comprising;
from a source having textual information with a variety of phrases related to the context of the domain obtaining textual contents as data directed to the context of the domain by querying the source with phrases representative of the subject matter of the domain regardless and irrespective of any language model; responsive to a state of a provided selector, determining is one state semantic relevancy or in another state semantic relevancy and lexical relevancy of the textual contents to the context of the domain; discarding at least a part of the textual contents that contain textual terms determined as irrelevant to the context of the domain, thereby retaining, as retained data, at least a part of the textual contents that contain textual terms determined as relevant to the context of the domain; and adapting the language model by incorporating therein at least a part of the textual terms of the retained data, wherein the method is performed on an at least one computerized apparatus configured to perform the method and equipped for communication with the source.