LOW LATENCY IN-LINE DATA COMPRESSION FOR PACKET TRANSMISSION SYSTEMS

摘要

Deep packet inspection (DPI) techniques are utilized to provide data compression, particularly necessary in many bandwidth-limited communication systems. A separate processor is initially used within a transmission source to scan, in real time, a data packet stream and recognize repetitive patterns that are occurring in the data. The processor builds a dictionary (ruleset), storing the set, of repetitive patterns and defining a unique token ID to be associated with each pattern. Thereafter, the DPI engine uses this ruleset to recognize the repetitive data patterns and replace each relatively long data pattern with its short token ID, creating a compressed data packet.

主权项

1. A method of creating data compression in a stream of data packets, the method comprising
analyzing an initial sample of the packet stream to identify data patterns; creating a ruleset of identified data patterns and associating a unique token identification (ID) with each identified data pattern; providing the ruleset to a deep packet inspection engine; directing the stream of data packets through the deep packet inspection engine; scanning each packet in the deep packet inspection engine to recognize data patterns based on the provided ruleset; removing each recognized data pattern and replacing it with an associated token ID from the provided ruleset and information defining a location within the packet stream where the recognized data pattern was removed, to create a compressed packet.