FILE PROCESSING WORKFLOW MANAGEMENT

摘要

The present subject matter relates to management of a file processing workflow over processing instances. In an example implementation, a notification message is received from a producer-processing instance of a cluster of processing instances. The notification message comprises a cluster identifier of the cluster associated with the producer-processing instance, and a data resource identifier associated with output data produced by the producer-processing instance in a file processing workflow. Further, the notification message received from the producer-processing instance is forwarded based on the cluster identifier to a message queue for the cluster maintained in the computer. The notification message is transmitted from the message queue for the cluster to a consumer-processing instance of the cluster for processing the output data based on the data resource identifier.

主权项

1. A method for managing a file processing workflow over multiple processing instances, the method comprising:
maintaining, by a computing system, a message queue for a cluster of processing instances, the cluster of processing instances comprising at least one producer-processing instance and at least one consumer-processing instance; receiving, by the computing system from a producer-processing instance of the cluster, a notification message comprising a cluster identifier of the cluster associated with the producer-processing instance, and a data resource identifier associated with output data produced by the producer-processing instance in the file processing workflow; forwarding, by the computing system, the notification message received from the producer-processing instance to the message queue for the cluster based on the cluster identifier; and transmitting, by the computing system, the notification message from the message queue for the cluster to a consumer-processing instance of the cluster for processing the output data based on the data resource identifier.