OPTIMIZING INCREMENTAL LOADING OF WAREHOUSE DATA

摘要

In various embodiments, a data integration system is disclosed which enables incremental loads into a data warehouse by developing a data partitioning plan and selectively disabling and enabling indexes to facilitate incremental loads into fact tables.

主权项

1. A method, comprising:
receiving, by a computing system, a data dictionary that specifies a structure of data to be loaded into a data warehouse; determining, by the computing system, a plurality of partitions using the data dictionary; identifying, by the computing system, data to be incrementally loaded into the data warehouse; determining, by the computing system, which partitions of the plurality of partitions are affected by the data to be incrementally loaded into the data warehouse; and selectively disabling one or more indexes on each affected partition of the plurality of partitions in order to load the data into the data warehouse.