METHOD, DEVICE AND SYSTEM FOR PROCESSING REPETITIVE DATA

摘要

The present disclosure introduces a method, an apparatus, and a system of processing repetitive data. In an example embodiment, the data structure of the comparison data to be compared is processed as having a same data structure of the data in the repetition database. The repetition database is formed by an internal memory mapping after processing data in a database according to a preset data structure. The processed comparison data is compared with data in the repetition database to determine whether the comparison data is repetitive data. After it is determined that the comparison data is not repetitive data, the comparison data is written into the database. The techniques described herein improve the efficiency of the servers for eliminating repetitive data and save the server resources.