SYSTEM FOR LINKING DIVERSE DATA SYSTEMS

摘要

A system creates an abstraction layer surrounding a diverse data system including multiple different databases. Data is received from data sources and ingested into the various databases according to a core model. New instances of the core model are created and added to a larger linked data model (LDM) when new data sources are added to the system. The LDM captures the linkages between different linked data objects and links across different databases. Accordingly, applications are able to access or explore the linked data stored in different databases without prior knowledge of the linking relationships.

主权项

1. A method comprising:
receiving a dataset at a communication interface, the dataset including dataset context information comprising metadata for the dataset; determining by a processor a core model correlating to the dataset based on the dataset context information, the core model comprising a first dataset type node, a first database node, and a relationship edge establishing a relationship property for storage of the first dataset type in the first database node, the first database node corresponding to a first database of a plurality of databases in a diverse data system; determining by the processor that a first portion of the dataset correlates to the first dataset type node; determining by the processor the first database as a destination for storage of the first portion of the dataset based on the relationship edge between the first dataset type node and the first database node in the core model; transmitting by the communication interface the first portion of the dataset to the first database for storage therein; and instantiating, by linked data model (LDM) control circuitry, a first LDM instance in an LDM, the first LDM instance comprising: definitional structure that mimics the core model; a representation of the first portion of the dataset as an instance of the first dataset type node of the core model; and a representation of the first database as an instance of the first database node of the core model.