USE OF SOLID STATE STORAGE DEVICES AND THE LIKE IN DATA DEDUPLICATION

摘要

Systems and methods of data deduplication are disclosed comprising generating a hash value of a data block and comparing the hash value to a table in a first memory that correlates ranges of hash values with buckets of hash values in a second memory different from the first memory. A bucket is identified based on the comparison and the bucket is searched to locate the hash value. If the hash value is not found in the bucket, the hash value is stored in the bucket and the data block is stored in a third memory. The first memory may be volatile memory and the second memory may be non-volatile random access memory, such as an SSD. Rebalancing of buckets and the table, and use of additional metadata to determine where data blocks should be stored, are also disclosed.

主权项

1. A method of deduplicating data, comprising:
generating a hash value for a data block; comparing the hash value to a table in a first memory, the table correlating ranges of hash values with buckets of hash values in a second memory different from the first memory; identifying a bucket based on the comparison; search the identified bucket in the second memory; and if the hash value is not found in the bucket, storing the hash value in the bucket; and storing the data block in a third memory.