摘要 |
The present invention includes a memory unit and a processor coupled to a memory unit. The processor is operable to group a plurality of subsets of data from an input data stream, compute a first hash value corresponding to a first grouped subset of data and detect a match between the first hash value and a second hash value stored in a hash table. The processor is also configured to monitor a hash value match frequency for the input data stream by incrementing a counter value responsive to a detection of the match and determine an entropy level (i.e. the number of subsets having different values) for the input data stream based on the counter value relative to a frequent hash value match threshold. If the counter value meets or exceeds the frequent hash value match threshold, this indicates low entropy and data compression is initiated. However if the count fails to meet the threshold, this indicates high entropy and compression is not performed. |