SYSTEMS AND METHODS FOR EFFICIENT DATA INGESTION AND QUERY PROCESSING

摘要

A query may be provided to aggregators at hierarchical levels in an in-memory data storage module. The query may be provided to leaf nodes of the in-memory data storage module. The leaf nodes may execute the query, returning results of the query to the aggregators. One or more aggregations may be performed based on the results. In an embodiment, log entries associated with a logged event may be serialized and divided into distributed chunks for storage in the leaf nodes. A leaf node, from the leaf nodes, having storage capacity for a distributed chunk may be identified. The distributed chunk may be stored in the leaf node.

主权项

1. A system comprising:
at least one processor; and a memory storing instructions configured to instruct the at least one processor to perform: providing a query to aggregators at hierarchical levels in an in-memory data storage module; providing the query to leaf nodes of the in-memory data storage module; executing the query on the leaf nodes; returning results of the query to the aggregators; and performing one or more aggregations on the results of the query.