SYSTEM AND METHODS FOR RAPID DATA ANALYSIS

摘要

A method for rapid data analysis comprising receiving and interpreting a query, collecting a first data sample from the first set of data shards, calculating an intermediate result to the query based on analysis of the first data sample, identifying a second set of data shards based on the intermediate result, collecting a second data sample from the second set of data shards, and calculating a final result to the query based on analysis of the second data sample.

主权项

1. A method for rapid data analysis comprising:
receiving and interpreting a query, wherein interpreting the query comprises translating strings of the query to integers using a string translator, wherein interpreting the query further comprises identifying a first set of data shards containing data relevant to the query; collecting a first data sample from the first set of data shards, wherein collecting the first data sample comprises collecting data from each of the first set of data shards, wherein collecting data from each of the first set of data shards comprises collecting only a subset of data contained within each of the first set of data shards; calculating an intermediate result to the query based on analysis of the first data sample; identifying a second set of data shards based on the intermediate result; collecting a second data sample from the second set of data shards, wherein collecting the second data sample comprises collecting data from each of the second set of data shards, wherein collecting data from each of the second set of data shards comprises collecting a complete set of data contained within each of the second set of data shards; and calculating a final result to the query based on analysis of the second data sample.