REDUCING DIGEST STORAGE CONSUMPTION BY TRACKING SIMILARITY ELEMENTS IN A DATA DEDUPLICATION SYSTEM

摘要

For reducing digests storage consumption in a data deduplication system using a processor device in a computing environment, input data is partitioned into chunks, and the chunks are grouped into chunk sets. Digests are calculated for input data and stored in sets corresponding to the chunk sets. Similarity elements are calculated for the input data and the similarity elements are stored in a similarity search structure, and the number of similarity elements associated with a chunk set which are currently contained in the similarity search structure is maintained for each chunk set.

主权项

1. A method for reducing digests storage consumption by tracking numbers of similarity elements in a similarity search structure in a data deduplication system using a processor device in a computing environment, comprising:
partitioning input data into chunks and grouping the chunks into chunk sets; calculating digests for the input data and storing the digests in sets corresponding to the chunk sets; calculating similarity elements for the input data and storing the similarity elements in a similarity search structure; and maintaining for each one of the chunk sets a number of the similarity elements associated with the chunk set which are currently contained in the similarity search structure.