Data lineage in data warehousing environments

摘要

A system for providing data lineage information for data warehouse objects, the system including a plurality of job descriptions, a log for recording operational information of any of the jobs when any of the jobs are run, a plurality of schemas of databases accessed by the jobs, and a binding service configured to combine information from the job descriptions, the log, and the schemas to provide a data lineage for a data object of a data warehouse.

主权项

1. A system for providing data lineage information for data warehouse objects, the system comprising:
a data warehouse populated by
a plurality of job descriptions describing jobs operating on data warehouse objects;a log for recording operational information of any of said jobs when any of said jobs are run;a plurality of schemas of databases accessed by said jobs; and a hardware data processing device providing a binding service configured to combine information from said job descriptions, said log, and said schemas to provide a data lineage for a data object of the data warehouse, wherein during combining job parameter variables within the job descriptions are replaced with database specific information obtained from the log.