Selective checkpointing of links in a data flow based on a set of predefined criteria

摘要

Techniques are disclosed for qualified checkpointing of a data flow model having data flow operators and links connecting the data flow operators. A link of the data flow model is selected based on a set of checkpoint criteria. A checkpoint is generated for the selected link. The checkpoint is selected from different checkpoint types. The generated checkpoint is assigned to the selected link. The data flow model, having at least one link with no assigned checkpoint, is executed.

主权项

1. A computer program product for qualified checkpointing of a data flow model having a plurality of data flow operators and a plurality of links connecting the data flow operators, the computer program product comprising:
a non-transitory computer-readable medium having program code embodied therewith, the program code executable by one or more computer processors to:
select a link of the plurality of links of the data flow model, that satisfies one or more checkpoint criteria from a predefined set of checkpoint criteria;generate a checkpoint for the selected link, wherein the checkpoint is selected from a retargetable checkpoint, a connection checkpoint, a parallel checkpoint, a bottleneck checkpoint, and a recovery checkpoint, wherein at least four of the retargetable checkpoint, the connection checkpoint, the parallel checkpoint, the bottleneck checkpoint, and the recovery checkpoint are generable by the program code, wherein the generated checkpoint is assigned to the selected link; andexecute the data flow model, wherein at least one link of the plurality of links of the data flow model has no assigned checkpoint.