Connection redistribution in load-balanced systems

摘要

Methods and apparatus for connection redistribution in load-balanced systems that include multiple load balancers each serving multiple nodes. In the connection redistribution method, each node estimates a connection close rate, which may be based on an estimation of the percentage of the overall client traffic received by the respective load balancer that is being handled by the node. The node generates close requests for connections between the respective load balancer and clients according to the connection close rate. The node sends the close requests to its load balancer, which forwards the close requests to the appropriate clients. Upon receiving a close request, a client may close the connection(s) indicated by the request, obtain a public IP address for a load balancer, and initiate new connection(s) to the respective load balancer via the public IP address.

主权项

1. A network-based system, comprising:
a plurality of computing devices implementing a plurality of nodes each configured to provide one or more functionalities of the network-based system, wherein the plurality of nodes are grouped into a plurality of node groups each comprising two or more of the nodes; and a plurality of load balancers each fronting at least one of the plurality of node groups, each load balancer configured to:
receive client requests from a plurality of client devices via connections over a network between the client devices and the load balancer; anddistribute the received client requests among the nodes in a node group corresponding to the load balancer according to a load balancing technique; wherein each of the plurality of nodes is further configured to:
generate connection close requests for connections between the client devices and a corresponding one of the plurality of load balancers according to a connection close rate for the node, each connection close request indicating one or more connections; andsend the connection close requests to the corresponding load balancer; wherein each load balancer is further configured to forward connection close requests received from the nodes in its corresponding node group to appropriate ones of the plurality of client devices via respective connections; and wherein a connection close request received from one of the plurality of load balancers causes a client device to close one or more indicated connections to the load balancer and open one or more new connections to at least one of the plurality of load balancers.