Accessing data in column store database based on hardware compatible data structures

摘要

Embodiments of the present invention provide one or more hardware-friendly data structures that enable efficient hardware acceleration of database operations. In particular, the present invention employs a column-store format for the database. In the database, column-groups are stored with implicit row ids (RIDs) and a RID-to-primary key column having both column-store and row-store benefits via column hopping and a heap structure for adding new data. Fixed-width column compression allow for easy hardware database processing directly on the compressed data. A global database virtual address space is utilized that allows for arithmetic derivation of any physical address of the data regardless of its location. A word compression dictionary with token compare and sort index is also provided to allow for efficient hardware-based searching of text. A tuple reconstruction process is provided as well that allows hardware to reconstruct a row by stitching together data from multiple column groups.

主权项

1. A method of encoding data into a hardware-favorable form for a database, said method comprising:
profiling columns of the data; compressing the columns of the data into column groups having one or more columns based on the profile of the columns of data; determining a fixed width for each of the column groups; and writing the column groups with the selected fixed width into a column-store database.