METHOD AND APPARATUS FOR CRAWLING WEB PAGE

摘要

PURPOSE: A webpage crawling method and an apparatus thereof are provided to reduce crawling working time by increasing probability to search for content of a web page having specific information through dynamic control of crawling depth. CONSTITUTION: A web address obtaining unit(210) obtains a web address list which is linked on a route web address list. A webpage evaluating unit(220) obtains content about a web address page by visiting web addresses based on the web address list. A crawling depth controlling unit(230) controls crawling depth according to an evaluation result.