Automated data warehouse migration

摘要

Systems, apparatus, computer-readable storage media, and methods are disclosed for allowing analysis, migration, and validation of data from a source environment (such as an RDBMS system) to a target environment (such as a data warehouse (DW) appliance). In one example, a method comprises analyzing a source database, a source ETL environment, a target database, and a target ETL environment to produce configuration data, the configuration data being used for generating a mapping of the source database to a target database in the target database environment, a mapping of the source DDL code to target DDL code in the target database environment, and a mapping of source ETL code to target ETL code for the target database environment, and migrating at least one table from the source database, at least a portion of the source DDL code, and at least a portion of the source ETL code to the target database environment, where the migrating is based at least in part on the mapping generated using the configuration data.

主权项

1. A method of migrating data from a source database environment to a target database environment, the source database environment including at least one source database, the method comprising:
with a computer, analyzing the source database environment and the target database environment, wherein the analyzing comprises extracting a validation criteria list, the validation criteria list comprising a plurality of data validation test cases; generating based on the analyzing, a conversion inventory of the source database environment and a configuration data file identifying at least one mapping code and/or script the configuration data file for generating a mapping for converting at least one table in the source database to a format compliant with a target database in the target database environment, the conversion inventory comprising extraction, transformation, and loading (ETL) code from the source database environment; generating a target-compliant mapping based on the at least one mapping code and/or script identified by the configuration data file and at least one ETL process characteristic associated with one or both of the source database environment and the target database environment, wherein the at least one process characteristic is stored in an ETL repository, and wherein the generating the target-compliant mapping comprises mapping one or more validation structured query language (SQL) statements based on the extracted validation criteria list; and with the computer, migrating the at least one table from the conversion inventory of the source database to the target database environment to produce migrated data in the target database environment, wherein the migrating is performed based at least in part on the target-compliant mapping.