Preferential selection of candidates for delta compression

摘要

A computer-implemented method and system for improving efficiency in a delta compression process in a data storage system selects a data chunk to delta compress and generates a sketch for the selected data chunk. The method and system search for a set of candidate data chunks with a matching sketch and rank the set of candidate data chunks by degree of sketch matching. The set of candidate data chunks are tie-braked using location status data for each candidate and the selected data chunk is delta compressed with a selected candidate data chunk. The delta compressed selected data chunk is then stored in a data storage system.

主权项

1. A computer-implemented method for improving efficiency in a delta compression process in a data storage system, the method comprising:
selecting a data chunk to delta compress; generating a sketch for the selected data chunk; searching for a set of candidate data chunks using the sketch; ranking the set of candidate data chunks by degree of sketch matching; tie-breaking the set of candidate data chunks, where the set of candidate data chunks has an equal degree of sketch matching, using location status data for each candidate data chunk, wherein the location status data indicates the location and status of the candidate data chunk and the location status data is at least one of a compressed in a cache status, a decompressed in a cache status, or a compressed in a data storage status, wherein tie-breaking the set of candidate data chunks prefers a decompressed in a cache status over a compressed in a cache status; delta compressing the selected data chunk with a selected candidate data chunk; and storing the delta compressed selected data chunk in the data storage system.