Systems and methods for server surge protection in a multi-core system

摘要

The present application is directed towards systems and methods for providing connection surge protection to one or more servers by an intermediary multi-core system. A packet processing engine of a multi-core device deployed as an intermediary between a plurality of clients and one or more servers determines an estimated number of total pending requests received by all packet processing engines based on a value of a local counter of received requests, the total number of pending requests received by all other packet processing engines at a last predetermined interval, and a rate of change of the total number of pending requests received by all other packet processing engines multiplied by the time since the last predetermined interval. The packet processing engine applies a surge protection policy to received pending requests responsive to the determined estimated number of total pending requests.

主权项

1. A method for providing connection surge protection to a server by
a device having multiple cores, the method comprising:
receiving, by a first packet processing engine of a plurality of packet processing engines executing on a corresponding plurality of cores of a device, a first request from a client to connect to a server;determining, by the first packet processing engine, that a global number of requests received by the plurality of packet processing engines to connect to the server has reached a connection rate limit;retrieving, by the first packet processing engine, the global number of requests to connect the server from the value of a global counter, the global counter comprising a sum of local counters of received requests maintained by each packet processing engine of the plurality of packet processing engines; anddelaying, by the device responsive to the determination, processing of the first request to connect to the server for a predetermined time based on a number of packet processing engines.