System and method for distributed load balancing with load balancer clients for hosts

摘要

Embodiments may include a load balancer configured to, for a given packet received from a remote client, select a host computer of a plurality of host computers according to a load balancing protocol, the selection based on load information updates received from the plurality of host computers. Each load information update may indicate a measure of the respective host computer's capacity to service additional connections with remote clients. The load balancer may provide the given packet to the selected host computer for processing by an application component on the selected host computer, and subsequent to determining that a specific application component on one of the plurality of host computers does not have capacity for additional connections based on the load information updates, continue to send packets for existing connections serviced by the specific application component to the respective host computer without sending packets for new connections to that host computer.

主权项

1. A system, comprising:
a plurality of computers coupled through a network, wherein the plurality of computers are configured to implement:
a plurality of load balancer clients each associated with a respective application component, wherein each load balancer client is configured to:
provide load information updates to the load balancer over time, wherein the load information of each update indicates a measure of the respective application component's capacity to service additional connections with remote clients; andfor a given packet received from the load balancer, provide information from that packet to the respective application component; anda plurality of load balancers, wherein each load balancer is configured to:
for a given packet received from a remote client, select a particular load balancer client according to a load balancing protocol, the selection based on the load information updates received from the load balancer clients;provide the given packet to the selected load balancer client for processing by the respective application component; andsubsequent to determining that a specific application component does not have capacity for additional connections based on the load information updates, continue to send packets for existing connections serviced by the specific application component to the respective load balancer client without sending packets for new connections to that load balancer client;wherein at least one of the load balancer clients is further configured to:
send a first load information update to a first load balancer, wherein the first load information update specifies that the given host does not have capacity to receive additional connections from the first load balancer; andsend a second load information update to a second load balancer, wherein the second load information update specifies that the given host has capacity to receive connections from the second load balancer;wherein for at least a period of time, the at least one load balancer client receives packets for existing connections, without receiving packets for new connections, from the first load balancer while receiving packets for new connections from the second load balancer.