Importing data into dynamic distributed databases

摘要

The present invention extends to methods, systems, and computer program products for importing data into dynamic distributed databases. Embodiments of the invention include an import service that facilitates data imports without any distribution logic on a tenant. A tenant (caller) provides data in essentially any order. The import service understands the distribution of data across multiple databases and determines for any given piece of import data what database the import data is to be inserted into. Accordingly, the tenant (caller) is relieved from having to know how the data is distributed across a set (of potentially hundreds or thousands) of databases. The import service can group sets of data destined for a given database together and can use batch operations to increase efficiency.

主权项

1. At a computer system, the computer system including a processor and system memory, the computer system included in a dynamic distributed database system, the dynamic distributed database system maintaining a plurality of databases across a plurality of nodes, a method for importing data into a database maintained by the dynamic distributed database system, the method comprising:
accessing a portion of data for a tenant, the portion of tenant data within a data range of the database; accessing a global partition map for the dynamic distributed database system, the global partition map mapping tenant data ranges to databases from among the plurality of databases and mapping databases to nodes from among the plurality of nodes; referring to the global partition map to identify a database, from among the plurality of databases, that is to store the portion of tenant data based on the tenant data range; referring to the global partition map to identify a node, from among the plurality of nodes, that hosts the database; and scheduling the portion of tenant data for import into the database by enqueuing the portion of tenant data in a queue for the node.