| 摘要 |
Embodiments of the present invention provide a method for processing data, which comprises: constructing a data window that slides along a data flow, wherein a length of the data window is a preset number of bytes; when the data window slides, determining whether a hash value corresponding to central position data of the data window is an extreme value; if yes, determining that a position is a first intermediate extreme value point, and the data window continuing to slide so as to determine subsequence intermediate extreme value points; if no, the data window continuing to slide so as to determine the first intermediate extreme value point; and extracting data between adjacent intermediate extreme value points to form valid data fragments and using data except for intermediate extreme value points as invalid data fragments. The embodiments of the present invention also provide an apparatus for processing the data. Adoption of the present invention can improve an effect of data deduplication, improve data processing efficiency, and reduce management and maintenance costs of the data fragments. |
