EXTRACTION OF MULTIPLE ELEMENTS FROM A WEB PAGE

摘要

A tool is provided that allows a user to select a portion of a web page that contains both labels and data values for a set of fields. The tool extracts the labels and the data values. The user can start a data extraction process to query from other pages that are similarly-formatted to the first page and extract data from these other pages. The relationship between the labels and the values can be determined by traversing the domain object model (DOM) of the first page. The tool may be integrated into a custom web browser that includes a user interface (UI) element that can be switched on and off. When the UI element is off, selection of text operates as in a normal web browser. When the UI element is switched on, selection of text operates as described above to facilitate the extraction of data.

主权项

1. A system comprising:
a user interface module configured to:
present a web page;receive a selection of multiple elements on the web page; andidentify a set of one or more key-value pairs from the selection, based on a domain object model (DOM) of the web page; and a scraper module configured to:
access a set of one or more additional web pages, each additional web page having similar formatting to the web page presented by the user interface module; andfor each web page in the set of additional web pages, extract values corresponding to the identified set of key-value pairs, based on a DOM of each web page.