Just-in-Time Data Quality Assessment for Best Record Creation

摘要

Systems and methods for just-in-time data quality assessment of best records created during data migration are disclosed. A data steward includes tools for creating and editing a best record creation strategy that defines how records from multiple systems will be integrated into target systems. At design time, the data steward can generate best record creation and validation rules based on the best record creation strategy. The data steward can apply the best record creation and validation rules to a sample of matched records from multiple data sources to generate a sample set of best records. The efficacy of the best record creation rules can be evaluated by assessing the number of fields in the sample set that fail the validation rules. During review, the validation rules can be applied to edits to the best records received from a human reviewer to ensure compliance with the best record creation strategy.

主权项

1. A method comprising:
receiving, in a computer system, a best record strategy, wherein the best record strategy defines how to create best record data; generating, in the computer system, a plurality of best record creation rules based on the best record strategy; receiving, in the computer system, a first plurality of record data from a plurality of sources; applying, in the computer system, the plurality of best record creation rules to the first plurality of record data to generate the best record data; and generating, in the computer system, a plurality of confidence scores corresponding to the best record data, wherein the confidence scores describe the level of quality of the best record data.