Scalable Grid Deduplication

摘要

A system, a method, and a computer program product for performing deduplication of data using a scalable deduplication grid are disclosed. A listing of a plurality of zone stamps is generated, where each zone stamp represents a zone in the plurality of zones in a data stream. The listing contains a logical arrangement of the plurality of zone stamps obtained from each storage location and being accessible by a plurality of servers. A first zone stamp in the listing is compared to a second zone stamp in the listing. The first and second zones are delta-compressed based on a determination that the first zone stamp is substantially similar to the second zone stamp. A server is selected to perform the comparison and delta-compression.

主权项

1. A computer implemented method, comprising
generating a listing of a plurality of zone stamps, each zone stamp representing a zone in the plurality of zones in a data stream, the generated listing containing a logical arrangement of the plurality of zone stamps obtained from each storage location and being accessible by a plurality of servers; comparing a first zone stamp in the plurality of zone stamps contained in the generated listing to a second zone stamp in the plurality of zone stamps contained in the generated listing, the first zone stamp representing a first zone in the plurality of zones and the second zone stamp representing a second zone in the plurality of zones; delta-compressing the first zone and the second zone based on a determination that the first zone stamp is substantially similar to the second zone stamp; and selecting, based on the generated listing, a server in the plurality of servers to perform the comparing and the delta-compressing.