METHOD AND APPARATUS FOR EXTRACTION OF TEXTUAL CONTENT FROM HYPERTEXT WEB DOCUMENTS

摘要

Textual content is extracted from hypertext documents by generating for each text document a pruned document model tree of merged text nodes by removing selected tag nodes from a document model tree of the text document, calculating for each merged text node of the pruned document model tree a set of text features which are compared with predetermined feature criteria to decide whether the merged text node is an informative merged text node, and assembling the informative merged text nodes to generate a text file containing the textual content.