| 摘要 |
Processing a batch of input data includes reading the batch including multiple records and passing the batch through a dataflow graph. At least one but fewer than all of the graph components includes a checkpoint process for an action performed for each of multiple units of work associated with one or more of the records. The checkpoint process includes opening a checkpoint buffer at the start of processing (207, 208). If a result from performing the action for a unit of work was previously saved in the checkpoint buffer (225), the saved result is used to complete processing (250) of the unit of work without performing the action again. If a result from performing the action for the unit of work is not saved in the checkpoint buffer, the action is performed (230) to complete processing of the unit of work and the result from performing the action is saved (240) in the checkpoint buffer. WO 2011/008734 PCT/US2O1O/0-41791 ,It C.! C) Z , 00 Z 0 -E C) |
