Distributed, real-time online analytical processing (OLAP)

摘要

Source data of an event stream is parsed and supplemented with additional data from reference data sources, producing an enriched event stream from the parsed event stream data. The data records of the enriched event stream are partitioned into data fields designated as a dimension partition and a metric partition, which are partitioned into sub-dimension projections mapped to a plurality of storage keys, such that each of the storage keys includes one or more placeholder wildcard values and each of the storage keys is stored into a database of the computer system by the computer processor. The stored storage keys are then aggregated onto a two-dimensional coordinate vector such that, if the computer processor identifies a permuted storage key having metric values for which a corresponding storage key already exists in the database, then the computer processor aggregates the metric values of the identified storage key with the metric values of the corresponding storage key, and if the computer processor does not identify the permuted storage key as having a corresponding storage key that already exists in the database, then the computer processor writes the metric values of the permuted storage key into the database, comprising initial values for the key combination of dimension values.

主权项

1. A method of online analytical processing (OLAP) of a computer system, the method comprising:
enriching a data record read from a source database of the computer system by a computer processor with one or more enriched data fields comprising data read from a reference database by the computer processor, wherein the data record includes multiple data fields, such that the enriched data record includes one or more of the multiple data fields of the data record and one or more of the enriched data fields; partitioning the multiple data fields of the enriched data record into a dimension partition and a metric partition; permuting the dimension partition and the metric partition of the enriched data record into sub-dimension projections that are mapped to a plurality of storage keys, such that each of the storage keys includes one or more placeholder wildcard values and each of the storage keys is stored into a database of the computer system by the computer processor; aggregating the storage keys of a permuted sub-dimension projections onto a two-dimensional coordinate vector such that, if the computer processor identifies a permuted storage key having metric values for which a corresponding storage key already exists in the database, then the computer processor aggregates the metric values of the identified storage key with the metric values of the corresponding storage key, and if the computer processor does not identify the permuted storage key as having a corresponding storage key that already exists in the database, then the computer processor writes the metric values of the permuted storage key into the database, comprising initial values for the key combination of dimension values.