Method and system for accelerating data movement using change information concerning difference between current and previous data movements

摘要

Techniques for accelerating data movement from a source storage system to a target storage system are described herein. According to one embodiment, a first data stream is received to be transmitted to a remote storage system over a network, the first data stream having multiple data objects, each identified by a data object identifier (ID). A difference is determined between the first data stream and a second data stream that has been previously transmitted to the remote storage system, including identifying one or more data objects that are added, deleted, and/or modified. Differential object information is transmitted to the target storage representing the difference between the first data stream and the second data stream, as well as one or more data objects that are missing in the second data stream without having to transmit all data objects of the first data stream.

主权项

1. A computer-implemented method for data movement over a network, the method comprising:
receiving a first data stream to be transmitted to a remote storage system over a network, the first data stream having a plurality of data objects, each identified by a data object identifier (ID); determining a difference between the first data stream and a second data stream that has been previously transmitted to the remote storage system, including identifying a data object of the first data stream that is added from the second data stream, a data object of the second data stream that is deleted, or a data object of the second data stream that has been modified in the first data stream; and transmitting differential object information representing the difference between the first data stream and the second data stream, as well as one or more data objects that are missing in the second data stream without having to transmit all data objects of the first data stream, such that the remote storage system can recover the first data stream based on the differential object information and the second data stream.