PERFORMING MULTIDIMENSIONAL SEARCH, CONTENT-ASSOCIATIVE RETRIEVAL, AND KEYWORD-BASED SEARCH AND RETRIEVAL ON DATA THAT HAS BEEN LOSSLESSLY REDUCED USING A PRIME DATA SIEVE

摘要

This disclosure relates to multidimensional search and retrieval, and keyword-based search and retrieval on losslessly reduced data by organizing prime data elements (the data structure that organizes the prime data elements is called the prime data sieve) using components of a structure of an input dataset so that searches can be performed on the losslessly reduced data based on the one or more components of the structure. For every prime data element, the prime data sieve can retain a reverse reference to the losslessly reduced representation of each chunk that refers to the prime data element. Some embodiments create and maintain a keyword index for losslessly reduced data. Some embodiments losslessly reduce input data using a distributed system.