State machine controlled dynamic distributed computing

摘要

A computer readable storage medium with executable instructions specifies the execution of a state machine operating across a set of computing nodes in a distributed computing system. The executable instructions execute a set of operators, where the execution of each operator is under the control of a state machine that periodically invokes pause control states to pause the execution of an operator in response to a violation of a service level agreement specifying an operating condition threshold within the distributed computing system. Partitions of input data are formed that are worked on independently within the distributed computing system. A set of data batches associated with the input data is processed. Data partition control states to process the partitions associated with the set of data batches are specified. Key control states to process a set of keys associated with a data partition of the partitions are defined.

主权项

1. A computer readable memory storing instructions that, if executed by a distributed computing system, causes the distributed computing system to perform a method, the method comprising:
executing a plurality of operators, wherein the execution of each operator is under the control of a state machine that invokes pause control states to pause the execution of an operator in response to a violation of a service level agreement specifying an operating condition threshold within the distributed computing system; forming partitions of input data that are worked on independently within the distributed computing system; and specifying data partition control states to process partitions associated with a set of data batches.