System and Methods for Storage Data Deduplication

摘要

Data in a storage system is deduplicated after receiving from at least one writing entity requests for a plurality of write operations for a corresponding plurality of data blocks in a storage object. The received blocks are buffered and sorted in order and a sequence of clumps is created from the buffered blocks, where each clump comprises a grouping of at least one of the sorted, buffered blocks. A boundary is determined between at least one pair of clumps based at least in part on the content of at least one of the buffered blocks, and it is then determined whether at least one of the clumps is a duplicate of a previously stored clump.

主权项

1. A method for deduplicating data in a storage system comprising:
receiving from at least one writing entity requests for a plurality of write operations for a corresponding plurality of blocks in a storage object; buffering the received blocks; sorting said buffered blocks; creating a sequence of clumps of said buffered blocks by adding blocks in sorted order to clumps, each clump comprising a grouping of at least one of the sorted, buffered blocks; determining a boundary between at least one pair of clumps based at least in part on the content of at least one of the buffered blocks; and determining that at least one of the clumps is a duplicate of a previously stored clump.