EFFICIENT MEMORY UTILIZATION IN A DISPERSED STORAGE SYSTEM

摘要

A method for improving memory utilization in a dispersed storage network (DSN). After a data object is received for storage in the DSN, it is determined whether a substantially identical data portion of the data object has previously been encrypted and stored. The determination may be made, for example, by comparing a portion reference value relating to the data object to portion reference information stored in DSN memory. If not detected, the data object is encrypted using an encryption pattern sequence and encryption key, at least one of which substantially identical to at least a portion of the data portion. The encrypted data object is then compressed using a pattern based data compression function, and the compressed data object is stored. The portion reference value is also stored in DSN memory.

主权项

1. A data deduplication method for execution by a computing device, wherein the method comprises:
receiving a storage request regarding storing a data object in dispersed storage network (DSN) memory; determining a data portion of the data object; determining that a substantially identical data portion is stored in the DSN memory; obtaining an encryption pattern sequence for the data portion; retrieving an encryption key from the DSN memory, wherein at least a portion of the encryption key is substantially identical to at least a portion of the data portion; encrypting the data portion using the encryption key and the encryption pattern sequence to produce an encrypted data portion that includes a plurality of encrypted data segments; compressing the encrypted data portion using a pattern based data compression function to produce a compressed data portion; and facilitating storage of the compressed data portion and the encryption pattern sequence in response to the storage request.