SEGMENT DATA VISIBILITY AND MANAGEMENT IN A DISTRIBUTED DATABASE OF TIME STAMPED RECORDS

摘要

A distributed database of time stamped records can be used to store time series data such as events occurring on the Internet. A distributed database of time stamped records can store segments of data that contain events for different time intervals. The volume of events occurring on the Internet introduces a “Big Data” variable that makes collections of data sets so large and complex they are difficult to manage. Disclosed are systems and methods to manage segments of a distributed database of time stamped records for optimal size (for storage and performance reasons etc.) and for proper visibility to data when different segments contain data for overlapping time periods.

主权项

1. A non-transitory computer readable medium comprising computer executable instructions stored thereon to cause one or more processors to:
receive a query request at a broker node from a query client, the query request related to a data source and a query time interval; determine data segments applicable to the query request via interaction with at least one of a coordination node and a zookeeper node, the determined data segments represented as a collection of blocks; and return a query response to the query client, the query response retrieved from the collection of blocks.