De-Duplication as Part of Other Routinely Performed Processes

摘要

A mechanism is provided for performing de-duplication process on a set of non-volatile memories as part of another process routinely performed on the set of non-volatile memories. A hash value of data stored at a first physical location in a non-volatile memory in the set of non-volatile memories is received from a non-volatile memory controller associated with the non-volatile memory. Responsive to the hash value matching one or more existing hash values for data stored at one or more other physical locations in the set of non-volatile memories, an optimal physical location is identified from the first physical location and the one or more other physical locations. Responsive to identifying the optimal physical location, a set of logical addresses associated with the hash values is updated to point to the optimal physical location. The non-optimal physical locations are further invalidated in order that the non-optimal physical locations are erased.

主权项

1. A method, in a data processing system, for performing de-duplication process on a set of non-volatile memories as part of another process routinely performed on the set of non-volatile memories, the method comprising:
receiving a hash value of data stored at a first physical location in a non-volatile memory in the set of non-volatile memories from a non-volatile memory controller associated with the non-volatile memory; determining whether the hash value matches one or more existing hash values for data stored at one or more other physical locations in the set of non-volatile memories; responsive to the hash value matching one or more existing hash values for data stored at one or more other physical locations in the set of non-volatile memories, identifying an optimal physical location from the first physical location and the one or more other physical locations, wherein the optimal physical location is based on at least one of a health indicator associated with each of the physical locations or physical attributes associated with each non-volatile memory drive where the physical locations reside; responsive to identifying the optimal physical location, updating a set of logical addresses associated with the hash values to point to the optimal physical location; and invalidating the non-optimal physical locations in order that the non-optimal physical locations are erased thereby making the non-optimal physical locations available for new programming.