APPARATUS, SYSTEM, AND METHOD FOR IMPROVED DATA DEDUPLICATION

摘要

An apparatus, system, and method are disclosed for improved deduplication. An input module 312, hash module 314, and transmission module 316 are implemented in a nonvolatile storage device 210. The input module 312 receives hash requests 302 from requesting entities internal or external to the nonvolatile storage device 210. Hash requests include a data unit identifier that identifies the data unit for which the hash is requested. The hash module 314 generates a hash for the data unit using a hash function. The hash is generated using computing resources of the nonvolatile storage device 210. The transmission module 316 sends the hash to a receiving entity when the input module 312 receives the hash request. A deduplication agent 110 uses the hash to determine whether or not the data unit is a duplicate of a data unit already stored in the storage system that includes the nonvolatile storage device 210.