Method and system for storing tabular data in a memory-efficient manner

摘要

Certain example embodiments relate to a method of storing data in a tabular data structure having columns and rows in a column-oriented storage system. At least one of the columns is divided into a plurality of segments. Each segment has an associated cell size that indicates the maximum size of the data items in the respective segment. When storing a data item into one of the segments, it is determined whether the size of the data item exceeds the cell size of the segment; and if the size of the data item exceeds the cell size of the segment, the cell size of the segment is adapted to accommodate the size of the data item. The adapting of the cell size of the segment to accommodate the size of the data item is performed independent of the cell sizes of the other of the plurality of segments.

主权项

1. A method of storing data, the method comprising:
dividing, in connection with at least one processor of a column-oriented storage system including a tabular data structure having columns and rows, at least one of the columns of the tabular data structure into a plurality of segments, wherein each segment has a plurality of cells and an associated cell size which indicates the maximum size of the data items in the respective segment; when storing a data item into one of the segments,
determining, in connection with the at least one processor of the storage system, whether the size of the data item exceeds the cell size of the segment; andif the size of the data item exceeds the cell size of the segment, adapting, in connection with the at least one processor of the storage system, the cell size of the segment to accommodate the size of the data item; wherein the adapting of the cell size of the segment to accommodate the size of the data item is performed without concomitantly adapting the cell sizes of the other of the plurality of segments.