Data cleaning

摘要

A computer-implemented method comprising partitioning data representing an input instance of a database including multiple tuples into multiple fragments of tuples, detecting tuples which violate a data quality specification in respective ones of the fragments, selecting a data cleaning asset on the basis of characteristics of errors in detected tuples for a fragment and based on declared asset capabilities, assigning a selected data cleaning asset to the fragment, the selected data cleaning asset to provide a set of candidate corrections for the detected tuples in the fragment, providing data representing an output instance of the database in which detected tuples are replaced with selected candidate corrections.

主权项

1. A computer-implemented method comprising:
partitioning data representing an input instance of a database including multiple tuples into multiple fragments of tuples; detecting tuples which violate a data quality specification in respective ones of the fragments; selecting multiple data cleaning assets on the basis of characteristics of errors in detected tuples for a fragment and based on declared asset capabilities; assigning multiple selected data cleaning assets to the fragment, the selected multiple data cleaning assets to provide sets of redundant candidate corrections for the detected tuples in the fragment; selecting a candidate correction for a tuple with a relatively higher confidence measure from measures for the candidate corrections in the redundant sets, and wherein a confidence measure includes a measure representing a majority vote for a tuple from multiple candidate corrections for the tuple from the redundant sets; and providing data representing an output instance of the database in which detected tuples are replaced with selected candidate corrections.