Method and system for data de-duplication

摘要

An apparatus may comprise a non-volatile random access memory to store data and a processor coupled to the non-volatile random access memory. The apparatus may further include a data de-duplication module operable on the processor to read a signature of incoming data, compare the signature to first data in the non-volatile random access memory, and flag the incoming data for discard when the signature indicates a match to the first data. Other embodiments are disclosed and claimed.

主权项

1. An apparatus, comprising:
a non-volatile random access memory to store data; a processor coupled to the non-volatile random access memory; and a data de-duplication module operable on the processor to:
read a signature of incoming data;compare the signature to first data in the non-volatile random access memory, the data de-duplication module to also include:
a hash generation module operable to produce a first hash that includes pointers to all portions of the first data stored in the non-volatile random access memory, and a first data key to uniquely identify the first data;a hash translation table generator operable to generate a first hashed system address corresponding to a first system memory address for the first data, and to map the first hashed system address and first data key to a first physical address containing the first data in the non-volatile random access memory; anda comparison module operable to compare a second hash and second data key of the incoming data with the first hash and first data key; andflag the incoming data for discard when the signature indicates a match to the first data based on the comparison of the second hash and second data key with the first hash and first data key.