发明名称 |
Accelerated deduplication |
摘要 |
Mechanisms are provided for accelerated data deduplication. A data stream is received an input interface and maintained in memory. Chunk boundaries are detected and chunk fingerprints are calculated using a deduplication accelerator while a processor maintains a state machine. A deduplication dictionary is accessed using a chunk fingerprint to determine if the associated data chunk has previously been written to persistent memory. If the data chunk has previously been written, reference counts may be updated but the data chunk need not be stored again. Otherwise, datastore suitcases, filemaps, and the deduplication dictionary may be updated to reflect storage of the data chunk. Direct memory access (DMA) addresses are provided to directly transfer a chunk to an output interface as needed. |
申请公布号 |
US8892528(B2) |
申请公布日期 |
2014.11.18 |
申请号 |
US201314010495 |
申请日期 |
2013.08.26 |
申请人 |
Dell Products L.P. |
发明人 |
Rao Goutham;Jayaraman Vinod |
分类号 |
G06F17/00;G06F3/06;G06F17/30 |
主分类号 |
G06F17/00 |
代理机构 |
Kwan & Olynick LLP |
代理人 |
Kwan & Olynick LLP |
主权项 |
1. A method, comprising:
performing, by using a processor, chunk boundary calculation and chunk fingerprint calculation on a data stream at a deduplication accelerator in a single pipeline stage, wherein chunk boundary calculation delineates a first chunk and chunk fingerprint calculation determines a chunk identifier for the first chunk, wherein chunk boundary calculation and chunk fingerprint calculation are used to perform deduplication on the data stream; and accessing a deduplication dictionary using the chunk identifier to determine whether a first chunk has previously been written to persistent storage. |
地址 |
Round Rock TX US |