MULTILEVEL LOAD BALANCING

摘要

Example embodiments relate to multilevel load balancing. In example embodiments, a system may maintain a system-level queue of jobs. The system may maintain a pool of active processing nodes. Each active processing node in the pool may pull jobs from the system-level queue at an arrival rate for the particular active processing node. Each active processing node may determine a node-level utilization that indicates the particular active processing node's capacity to process jobs at the arrival rate. Each active processing node may adjust the arrival rate based on the node-level utilization. The system may determine a system-level utilization based the number of active processing nodes in the pool and average processing rates of the active processing nodes in the pool. Each average processing rate may indicate the time it takes the particular active processing node to process jobs once pulled from the system-level queue.

主权项

1. A system for multilevel load balancing, the system comprising:
at least one processor to: maintain a system-level queue of jobs, the jobs being based on events received from client devices; maintain a pool of active processing nodes, each active processing node in the pool to:
pull jobs from the system-level queue at an arrival rate for the particular active processing node,determine a node-level utilization that indicates the particular active processing node's capacity to process jobs at the arrival rate, andadjust the arrival rate based on the node-level utilization; and determine a system-level utilization based the number of active processing nodes in the pool and average processing rates of the active processing nodes in the pool, wherein each average processing rate indicates the time it takes the particular active processing node to process jobs once pulled from the system-level queue.