SYSTEM AND METHOD FOR OPTIMIZING STORAGE OF MULTI-DIMENSIONAL DATA IN DATA STORAGE

摘要

This technology relates to method and optimization systems for optimizing storage of multi-dimensional data in data storage. The method comprises analyzing a plurality of queries received over period of time from one or more client machines. Then, a query pattern is determined from plurality of queries. Based on query pattern dimensionality of data is identified for determining data storage strategy. The dimensionality is characterized into 11 dimensions comprising 4 standard level dimensions and 7 higher level dimensions. A highest dimension out of 7 higher dimensions is parallel data storage dimension. Based on storage strategy, at least one of data and columns of a table is segmented in data storage. Next, data is stored in remote data storage when data is an element of last higher level dimension. Then, higher level dimensions are fragmented into one or more smaller level dimensions when data is element greater than 11 dimensions.

主权项

1. A method for optimizing storage of multidimensional data, the method comprising:
analyzing, by an optimization system, a plurality of queries received over a period of time from one or more client machines; determining, by the optimization system, a query pattern from the plurality of queries; identifying, by the optimization system, dimensionality of data based on the query pattern and determining a data storage strategy based at least in part on the dimensionality, wherein the dimensionality is characterized into 11 dimensions comprising 4 standard level dimensions and 7 higher level dimensions; and performing, based on the determined data storage strategy and by the optimization system, at least one of:
segmenting at least one of the data or columns of a table stored in a data storage based on the identified dimensionality;storing the data in a remote data storage when the data is an element of a last one of the higher level dimensions; orfragmenting the higher level dimensions into one or more lower level dimensions when the data is an element greater than the 11 dimensions.