Optimizing workflow engines

摘要

Techniques for implementing a workflow are provided. The techniques include merging a workflow to create a virtual graph, wherein the workflow comprises two or more directed acyclic graphs (DAGs), mapping each of one or more nodes of the virtual graph to one or more physical nodes, and using a message passing scheme to implement a computation via the one or more physical nodes.

主权项

1. A computer-implemented method for implementing a workflow, wherein the method comprises:
merging a workflow to create a virtual graph, wherein the workflow comprises two or more directed acyclic graphs (DAGs), wherein said merging comprises:
applying a label to each node of the two or more directed acyclic graphs, wherein nodes representing a same computation in each directed acyclic graph have a same label applied thereto;assigning each node in the two or more directed acyclic graphs with a unique label to a unique node in the virtual graph; andassigning each node in the two or more directed acyclic graphs that shares the same label with one or more additional nodes are assigned to a same node in the virtual graph; mapping each of one or more nodes of the virtual graph to one or more physical nodes; and using a message passing scheme to implement a computation via the one or more physical nodes.