发明名称 Load balancing web service by rejecting connections
摘要 A load balancer allocates requests to a pool of web servers configured to have low queue capacities. If the queue capacity of a web server is reached, the web server responds to an additional request with a rejection notification to the load balancer, which enables the load balancer to quickly send the rejected request to another web server. Each web server self-monitors its rejection rate. If the rejection rate exceeds a threshold, the number of processes concurrently running on the web server is increased. If the rejection rate falls below a threshold, the number of processes concurrently running on the web server is decreased.
申请公布号 US8769541(B2) 申请公布日期 2014.07.01
申请号 US200912651069 申请日期 2009.12.31
申请人 Facebook, Inc. 发明人 English Robert M.;Rothschild Jeffrey
分类号 G06F9/46 主分类号 G06F9/46
代理机构 Fenwick & West LLP 代理人 Fenwick & West LLP
主权项 1. A method comprising: receiving, at a web server of a pool of web servers, a request from a client via a load balancer, the load balancer for allocating requests to the pool of web servers, the web server having a capacity, wherein the capacity is a number of processes that are available to process requests; responsive to space being available in a queue, placing the request in the queue; responsive to the queue being full, sending a rejection notification to the load balancer to allow the load balancer to quickly send the rejected request to another web server in the pool; self-monitoring a rejection rate for requests to the web server; responsive to the rejection rate exceeding an upper threshold, increasing the capacity of the web server by increasing a number of processes that are able to process requests; and responsive to the rejection rate being lower than a lower threshold, decreasing the capacity by ending one of the plurality of processes executing on the web server.
地址 Menlo Park CA US