APPARATUS AND METHOD FOR FILE DEDUPLICATION IN DISTRIBUTED STORAGE SYSTEM

摘要

PURPOSE: A device and a method for eliminating the duplication of a file in order to reduce storage waste and network resource of an individual system are provided to prevent storage enlargement and system enlargement due to a duplicated file. CONSTITUTION: A fingerprinting unit(241) calculates a primary has value per chunk about an active file. A fingerprinting unit calculates a secondary hash value of a file unit by adding a first hash value calculated per chunk. A duplication check unit(242) detects redundancy of a file by performing one among chunk unit comparison, file unit comparison and a bit unit comparison. A duplicated file removing unit(243) removes the duplicated file.