METHOD OF AUTOMATED ANALYSIS OF TEXT DOCUMENTS

摘要

Automated analysis of text documents is used to scan text documents in order to find phrases or text fragments from other documents, or modifying the existing ones. A comparatively fast and universally applicable method finds phrases, sentences or even text fragments from other documents. The method includes: all electronic files containing model documents are converted to a given format; meaningful fragments, called “clauses”, are extracted from them; the converted files containing model documents are stored in the database; each electronic file containing a document to be analyzed is converted to the given format; clauses extracted from analyzed documents are compared with clauses extracted from model documents; fractions of clauses from an analyzed document matching clauses from each model document are calculated; fractions found are then compared with a pre-set threshold value in order to find out whether there are text fragments from a model document in the analyzed one.

主权项

1. A method of automated analysis of text documents, the method comprising:
converting electronic files containing model documents to a predefined format that is capable of representing all characters in all languages that the text documents are written; extracting clauses representing meaningful fragments from the model documents; storing the converted files containing model documents in a database; converting each electronic file containing a document to be analyzed into the predefined format; comparing clauses extracted from the analyzed documents are compared with clauses extracted from the model documents; calculating fractions of clauses from one of the analyzed documents matching clauses from each model document; comparing the fractions with a pre-set threshold value to identify if the analyzed document contains text fragments from at least one of the model documents.