ENHANCED DATA COMPRESSION FOR SPARSE MULTIDIMENSIONAL ORDERED SERIES DATA

摘要

Disclosed are methods and systems for significantly compressing sparse multidimensional ordered series data comprised of indexed data sets, wherein each data set comprises an index, a first variable and a second variable. The methods and systems are particularly suited for compression of data recorded in double precision floating point format.

主权项

1. A computer-implemented method of compressing a sparse multidimensional ordered series of spectroscopic data, the method comprising:
a) receiving the sparse multidimensional ordered series data, wherein the data comprise indexed data sets, each indexed data set comprising an index (n), a first variable (xn) representing a mass to charge ratio (m/z), and a second variable (yn) representing signal intensity; b) defining a predictor that calculates each first variable (xn) as a function of the index (n); c) assigning an amplitude code word to each yn based on the value and frequency of the yn; d) calculating a hop offset value (Δn) for each yn; e) assigning a hop code word to each Δn based on the value and frequency of the Δn; and f) generating a compressed output, said compressed output comprising:
i) a decoder legend comprising:
a description of the predictor;a reverse amplitude code word dictionary associated with yn; anda reverse hop code word dictionary associated with Δn; andii) code word data comprising an amplitude code word and a hop code word for each yn and each Δn, respectively.