SYSTEM AND METHOD FOR SEARCHING FOR DUPLICATE DATA

摘要

The invention concerns a method (200) and system (100) for searching for duplicate data. The method (200) includes the steps of: generating (212) at least one identifier from at least one portion of a first segment of data using a unique identifier function; generating (216) at least one identifier from at least one portion of a second segment of data using the unique identifier function; and comparing (220) at least one identifier associated with the first segment of data with at least one identifier associated with the second segment of data to determine whether the first segment of data is substantially identical to the second segment of data.