METHOD AND SYSTEM FOR DYNAMICALLY PARTITIONING VERY LARGE DATABASE INDICES ON WRITE-ONCE TABLES

摘要

Methods and systems for partitioning and dynamically merging a database index are described. A database index includes a single first-level index partition stored in a data cache. As the first-level index partition in the data cache reaches a predetermined size, it is copied to secondary storage and a new index partition is generated in the data cache. When the number of index partitions in secondary storage reaches some predetermined number, the index partitions are merged to create a single index partition of a higher level in a hierarchy of index partitions having an exponentially increasing size with each increase in level within the hierarchy.

主权项

1. A processor-implemented method for partitioning a database index, the method comprising:
after determining that a first-level index partition stored in a data cache exceeds a threshold size, performing a first-level partitioning operation to i) write the first-level index partition stored in the data cache to a secondary storage, and ii) generate a new first-level index partition in the data cache; and after determining that a number of first-level index partitions in the secondary storage has reached a predetermined number, performing a first-level merge operation to i) merge the predetermined number of first-level index partitions into a single second-level index partition, and ii) delete the predetermined number of first-level index partitions from the secondary storage.