Balancing a load on a multiple consumer queue

摘要

Disclosed are various embodiments for balancing a load on a queue among multiple consumers. A target polling hit rate is derived for at least one queue from a consumer load. The consumer load on the at least one queue is adjusted responsive to a change in an observed polling hit rate for the at least one queue.

主权项

1. A method, comprising:
deriving, in a computing device, a target polling hit rate from a plurality of consumer loads, individual ones of the plurality of consumer loads being described by a number of threads that read from at least one queue, the target polling hit rate being based at least upon a read rate of the at least one queue and an observed polling hit rate associated with the individual ones of the plurality of consumer loads; computing, in the computing device, the observed polling hit rate for the at least one queue from a polling hit rate history; updating, in the computing device, the observed polling hit rate for the at least one queue; and adjusting, in the computing device, at least one consumer load among the plurality of consumer loads on the at least one queue responsive to a change in the observed polling hit rate associated with the at least one consumer load among the plurality of consumer loads for the at least one queue.