Hierarchical caching system for lossless network packet capture applications

摘要

A system for providing lossless hierarchical caching is disclosed. The system may process, in a first thread, a first set of a plurality of packets in a first cache. Then, the system may determine if a condition associated with processing the first set of the packets indicates that there is potential for packet loss. If the system determines that there is potential for packet loss, a copy of a portion of the first set of the packets may be transmitted to a second cache. The system may process, in a second thread, the copy of the portion of the first set of the packets in the second cache. Additionally, the system may transmit a subset of packets from the first set of packets to a reorder queue for reordering the subset of packets if the subset of packets contain an identifier associated with the reorder queue.

主权项

1. A system for providing lossless hierarchical caching comprising:
a first server comprising:
a packet capture device that captures a plurality of packets, wherein the plurality of packets are managed in a queue by the packet capture device;a first cache controlled by the packet capture device, wherein the plurality of packets are received from the packet capture device;a second cache; anda processor that executes instructions to perform operations, the operations comprising:
processing, in a first processor thread, a first set of the plurality of packets in the first cache;determining if a first condition associated with processing the first set of the plurality of packets in the first cache indicates a potential for packet loss associated with the plurality of packets, wherein the first condition comprises a condition selected from the group consisting of a maximum work service time threshold being reached for the first processing thread, a detection of a stall condition in the queue, and a detection that greater than a threshold portion of the first cache is unused;transmitting, if the first condition indicates the potential for packet loss associated with the plurality of packets, a first copy of a portion of the first set of the plurality of packets to the second cache;processing, in a second processor thread, the first copy of the portion of the first set of the plurality of packets in the second cache; andtransmitting a subset of packets from the first set of packets to a reorder queue if the subset of packets contain an identifier associated with the reorder queue, wherein the subset of packets are reordered in the reorder queue into order in which the subset of packets were initially received by the system.