Capturing data packets from external networks into high availability clusters while maintaining high availability of popular data packets

摘要

A method and high availability cluster configuration for capture of data packets propagating in an external network into the cluster through a wired-tap connection between the cluster and at least one router of the external network. Captured packets are supplied with popularity tags and striped over high-access-rate non-transitory storage media belonging to a capture pool of serving nodes that are specially provisioned and selected by the master node. The captured packets are either devolved or demoted to low-access-rate non-transitory storage media of at least two serving nodes not including any backup master based on popularity metrics contained their tags. The demotion, devolution as well as determination of popularity metrics and setting of a popularity threshold are managed by a distributed management protocol.

主权项

1. A method for capturing data packets propagating in a network to a high availability cluster having a master node and serving nodes, said method comprising the steps of:
a) establishing a wired-tap connection between said high availability cluster and at least one router belonging to said network; b) capturing through said wired-tap connection captured data packets from among routed data packets being routed through said at least one router; c) attaching a packet popularity tag to each one of said captured data packets; d) striping said captured data packets over high-access-rate non-transitory storage media belonging to a capture pool of said serving nodes selected by said master node; e) writing said captured data packets from said high-access-rate non-transitory storage media to low-access-rate non-transitory storage media of at least two serving nodes of said high availability cluster; and f) retaining in said high-access-rate non-transitory storage media captured data packets in which said packet popularity tag exceeds a set threshold.