DATA INTEGRATION PIPELINE

摘要

A data integration pipeline is configured to receive and integrate raw data into a data processing system. Raw data may be defined as an electronic collection of data composed of information from multiple records, whose primary relationship to each other is their shared origin from a single or multiple databases. In integrating the raw data, the data integration pipeline may split the integration into two phases, more specifically: an ingest phase, and an import phase.