Efficient storage tiering

摘要

A method, article of manufacture, and apparatus for transferring data from a source tier to a target tier. In some embodiments, this may include dividing an object stored in the source tier into a plurality of segments, determining if the target tier is missing at least one of the segments, writing the missing segments to the target tier, and deleting the object from the source tier. In some embodiments, the object's metadata is updated to indicate that the object is in the target tier.

主权项

1. A method for transferring data from a source tier to a target tier in a data system, the method comprising:
storing a first object in the source tier, wherein storing the first object in the source tier includes dividing the first object into a first plurality of segments using a first segment technique and compressing the first plurality of segments using a compression technique of the source tier, and wherein the source tier deduplicates data based at least in part on the first segment technique; determining, using a processor, whether to transfer the first object from the source tier to the target tier, wherein the target tier deduplicates data based at least in part on a second segment technique that is different from the first segment technique used at the source tier, wherein the determination to transfer the first object is based at least in part on one or more policies for determining whether to transfer an object and a tier including at least one of the source tier and the target tier to which to transfer the object; decompressing the first plurality of segments using the compression technique of the source tier; re-segmenting the segmented first object comprising the first plurality of segments into a second plurality of segments based at least in part on the second segment technique of the target tier; transmitting to the target tier a representation of a first segment from the second plurality of segments; receiving from the target tier a response indicating that the first segment is not already present at the target tier, wherein the target tier determines based at least in part on the representation of first segment whether the first segment is already present at the target tier; compressing the first segment using a compression technique of the target tier; transferring the compressed first segment to the target tier in the event that the first tier is determined to be missing at the target tier; and deleting at least one of the first plurality of segments related to the first object from the source tier.