ENHANCED DATA COMPRESSION FOR SPARSE MULTIDIMENSIONAL ORDERED SERIES DATA

摘要

Disclosed are methods and systems for significantly compressing sparse multidimensional ordered series data comprised of indexed data sets, wherein each data set comprises an index, a first variable and a second variable. The methods and systems are particularly suited for compression of data recorded in double precision floating point format.

主权项

1. A computer-implemented method of compressing a sparse multidimensional ordered series of spectroscopic data, the method comprising:
a) receiving the sparse multidimensional ordered series data containing values that fall within a dynamic range of less than 10 orders of magnitude, wherein the data comprise indexed data sets, each indexed data set comprising an index (n), a first variable (xn) representing a mass to charge ratio (m/z), and a second variable (yn) representing signal intensity; b) defining a predictor that calculates each first variable (xn); c) assigning an amplitude code word to each yn; d) calculating a hop offset value (Δn) for each yn; e) assigning a hop code word to each Δn based on the value of the Δn; and f) generating a compressed output, said compressed output comprising:
i) a decoder legend comprising:
a reverse amplitude code word dictionary associated with yn; anda reverse hop code word dictionary associated with Δn; andii) code word data comprising an amplitude code word and a hop code word for each yn and each Δn.