Failure management in a distributed strict queue

摘要

Methods and systems for implementing failure management in a distributed strict queue are disclosed. A plurality of messages are distributed to a plurality of queue servers based on strict order parameters for the messages. Messages that share a value for the strict order parameter are distributed to the same queue server. The messages are enqueued at the queue servers. Messages that share a value for the strict order parameter are enqueued in a strict order based on the time of receipt at the queue server. One or more queue clients are configured to attempt message processing for the enqueued messages. Log data is received from the one or more queue clients at the queue servers. The log data is descriptive of the attempted message processing.

主权项

1. A system, comprising:
one or more computing devices configured to implement a distributed strict queue system, wherein the distributed strict queue system comprises a plurality of queue servers, and wherein the distributed strict queue system is configured to:
receive a plurality of messages, wherein each of the plurality of messages comprises a respective value for a strict order parameter;forward each of the plurality of messages to a respective queue server of the plurality of queue servers based on the respective value for the strict order parameter, wherein a range of values for the strict order parameter is divided among the plurality of queue servers;enqueue the plurality of messages at the plurality of queue servers, wherein individual ones of the plurality of messages that share a respective value for the strict order parameter are enqueued in a strict order based on time of receipt at the respective queue server;send individual ones of the enqueued messages to one or more queue clients, wherein the one or more queue clients are configured to attempt message processing for the individual ones of the enqueued messages; andreceive log data from the one or more queue clients at individual ones of the queue servers, wherein the log data is descriptive of the attempted message processing, and wherein the log data indicates respective message identifiers for the individual ones of the plurality of messages for which the message processing was attempted.