AUTOMATING EXTRACT, TRANSFORM, AND LOAD JOB TESTING

摘要

A method for testing an extract, transform, load job (ETL job) is provided. The method may include receiving an uploaded ETL job. The method may also include executing a functionality test of the uploaded ETL job using a test bucket. The method may further include determining the executed functionality test produces a failure result. The method may also include creating at least one test sub-job corresponding to at least one stage within on the uploaded ETL job. The method may further include generating a plurality of test data for each of the at least one created test sub-job. The method may also include executing the at least one created test sub-job using the plurality of generated test data. The method may further include creating a report based on a plurality of results associated with the at least one executed test sub-job.

主权项

1. A processor-implemented method for testing an extract, transform, load job (ETL job), the method comprising:
receiving, by a processor, an uploaded ETL job; executing a functionality test of the uploaded ETL job using a test bucket; determining the executed functionality test produces a failure result; creating at least one test sub-job corresponding to at least one stage within on the uploaded ETL job; generating a plurality of test data for each of the at least one created test sub-job; executing the at least one created test sub-job using the plurality of generated test data; and creating a report based on a plurality of results associated with the at least one executed test sub-job.