DETERMINING AND EXTRACTING CHANGED DATA FROM A DATA SOURCE

摘要

According to certain aspects, a computer system may be configured to obtain information indicating a plurality of groupings of data stored in a data source, the information indicating a number of data items included in each of the plurality of groupings; determine a first grouping of the plurality of groupings including one or more data items that have changed by comparing a first number of data items included in the first grouping and a historical first number of data items included in a corresponding local version of the first grouping; access data items included in the first grouping from the data source; compare the data items included in the first grouping to data items of the corresponding local version of the first grouping to determine which data items have changed; extract the changed data items of the first grouping; and forward the extracted data items to a destination system.

主权项

1. A computer system configured to obtain changed data from a data source, the computer system comprising:
one or more hardware computer processors configured to execute code in order to cause the system to:
obtain information indicating a plurality of groupings of data stored in one or more files or databases in a data source, the information indicating a number of data items included in each of the plurality of groupings;determine a first grouping of the plurality of groupings including one or more data items that have changed by comparing a first number of data items included in the first grouping and a historical first number of data items included in a corresponding local version of the first grouping, wherein the corresponding local version of the first grouping is created based on data items included in the first grouping at a first time prior to said obtaining the information indicating the plurality of groupings of the data;access data items included in the first grouping from the data source;compare the data items included in the first grouping to data items of the corresponding local version of the first grouping to determine which data items of the first grouping from the data source have changed;extract the changed data items of the first grouping; andforward the extracted changed data items to a destination system.