SYSTEMS AND METHODS FOR GENERATING CONCEPTS FROM A DOCUMENT CORPUS

摘要

Systems and method for generating concepts from a document corpus are disclosed. In one embodiment, a method for generating concepts from a document includes retrieving, a plurality of terms stored within a first lexicon. The method further includes, for individual terms stored within the first lexicon: determining a first frequency of the term within the document corpus, and determining a second frequency of the term within a comparison document corpus including a plurality of comparison documents, wherein the comparison document corpus is different from the document corpus. The method further includes, for individual terms within the first lexicon: determining a difference between the first frequency and the second frequency, comparing the difference between the first frequency and the second frequency to a comparison metric, and, when the difference between the first frequency and the second frequency satisfies the comparison metric, storing the term as a concept within a second lexicon.