Parallel Spatio Temporal Indexing for High-Update Workloads and Query Processing

摘要

Disclosed herein are system, method, and computer program product embodiments for providing a spatio-temporal index for high-update workloads and query processing. An embodiment operates by a first thread retrieving an update record from a first queue, the update record comprising a location component and a temporal component indicating a location of one of a plurality of mobile devices at a specified time, and updating a columnar-store database with the update record. The embodiment further operates by a second thread identifying a spatial grid of a spatial temporal index within a memory corresponding to the location component of the update record, and updating a temporal index of the spatial grid based on the temporal component of the update record.

主权项

1. A system comprising:
a memory structure configured to store location-based data associated with a plurality of mobile devices for a first period of time below a threshold; a disk structure configured to store location-based data associated with the plurality of mobile devices for a second period of time beyond the threshold, wherein the first period of time is contiguous with the second period of time; one or more processors including a plurality of thread pools, including a table thread pool, and an index thread pool, each thread pool configured to independently and in parallel update the location-based data or process queries associated with the location-based data; the table thread pool including a plurality of table threads configured to:
retrieve an update record from a first queue, the update record comprising a location component and a temporal component indicating a location of one of a plurality of mobile devices at a specified time, andupdating a columnar-store database with the update record; and the index thread pool including a plurality of index threads configured to:
identify a spatial grid of a spatial temporal index within the memory corresponding the location component of the update record, andupdate a temporal index of the spatial grid based on the temporal component of the update record.