System and Method for Automated Classification of Web pages and Domains

摘要

Representative sample pages from websites accessible to Internet users are manually selected and classified into pre-defined categories based on page content to create a training set as an input to a classifier. An automated analysis is performed to identify a list of catchwords comprising the most frequently referenced words, tags, and/or links from the classified samples in each category in the training set. A data mining tool generates unique sets of distinctive catchwords and/or distinctive combinations of catchwords that have a high probability of appearing only in a single one of the pre-defined content categories. The classifier utilizes the sets of distinctive catchwords/combinations to classify new pages into one or more of the pre-defined content categories.