COMPRESSION-AWARE PARTIAL SORT OF STREAMING COLUMNAR DATA

摘要

According to one embodiment of the present invention, a system for sorting data records generates a plurality of data structures associated with corresponding record fields used to sort the data records, and inserts values of the record fields into the corresponding data structures. Each of the data structures comprises one or more ordered parts, and each inserted value is inserted into a part of the corresponding data structure. Each part of a data structure corresponding to a record field having a sort priority immediately below another record field corresponds to a distinct value inserted into a part of the data structure corresponding to the other record field. The system processes the generated data structures to determine sorted data records. Embodiments of the present invention further include a method and computer program product for sorting data records in substantially the same manners described above.

主权项

1. A computer-implemented method of sorting data records comprising:
generating a plurality of data structures associated with corresponding record fields used to sort the data records, and inserting values of the record fields into the corresponding data structures; wherein
each of the data structures comprises one or more ordered parts;each inserted value is inserted into a part of the corresponding data structure; andeach part of a data structure corresponding to a record field having a sort priority immediately below another record field corresponds to a distinct value inserted into a part of the data structure corresponding to the other record field; and processing the generated data structures to determine sorted data records.