Message consumer orchestration framework

摘要

In a decoupled messaging system, a producer device sends produced messages to a message fabric. The message fabric either stores the received message in designated queues, from which consumer devices may retrieve the messages, or broadcasts the messages to consumer devices that subscribe to topics assigned to the messages. A message consumption orchestrator service gathers capabilities information for the message producer, the message fabric, and the message consumer, and configures resources allocated for the message consumer to more fully optimize message throughput. Further, the message consumption orchestrator identifies patterns in changes of the rate of produced messages, i.e., through analysis of historical data and/or received information. The message consumption orchestrator configures resources for the message consumer to account for predicted need based on the identified patterns.

主权项

1. A method comprising:
using a message consumer executing on a particular device to pull, from a message fabric, messages that were produced by a message producer; gathering capabilities information for at least one of:
the message producer,the message fabric, orthe message consumer; based, at least in part, on the capabilities information, automatically executing at least one consumer clone, of the message consumer, on one or more devices, other than the particular device; wherein, prior to executing the at least one consumer clone, the one or more devices are not being used to pull messages from the message fabric for the message consumer; wherein automatically executing the at least one consumer clone, of the message consumer, on one or more devices, other than the particular device is further based, at least in part, on a target pull rate for the message consumer pulling messages from the message fabric; wherein the method is performed by one or more computing devices.