Method and apparatus for reconciliation of multiple sets of data

摘要

A computer-implemented method for reconciling records from a plurality of data sets includes receiving a first data set from a left data source, retrieving data from the first data set, and placing the retrieved data from the first data set into a first abstract record from the left data source. The method also includes receiving a second data set from a right data source, retrieving data from the second data set, and placing the retrieved data from the second data set into a second abstract record from the right data source. The computer-implemented method also includes comparing the first abstract record and the second abstract record.

主权项

1. A computer-implemented method for reconciling records from a plurality of data sets, the method comprising:
receiving, by at least one data processing apparatus, a first data set from a right data source; retrieving, by at least one data processing apparatus, data from the first data set; placing, by at least one data processing apparatus, the retrieved data from the first data set into a first abstract record from the right data source; build, from the first data set in the right data source, a first key in the first abstract record; build, from the second data set in the left data source, a second key in the second abstract record; receiving, by at least one data processing apparatus, a second data set from a left data source; retrieving, by at least one data processing apparatus, data from the second data set; placing, by at least one data processing apparatus, the retrieved data from the second data set into a second abstract record from the left data source; comparing, by at least one data processing apparatus, using fuzzy matching, the first key and the second key to find differences in the data from the first data set and the second data set; determining, by at least one data processing apparatus, severity of a difference by (1) comparing determined non-reconciliation rates of the left data source with historical non-reconciliation rates of the left data source and comparing determined non-reconciliation rates of the right data source with historical non-reconciliation rates of the right data source, and (2) calculating, by at least one data processing apparatus, a rate of change of the differences in the data from the first data set and the second data set; and reporting, by at least one data processing apparatus, the severity to a second a data processing apparatus.