FAILURE RECOVERY OF A TASK STATE IN BATCH-BASED STREAM PROCESSING

摘要

Described herein are techniques for failure recovery of a task state in batch-based stream processing. A message including a batch of tuples can be unpacked into component tuples. The component tuples can be processed at a task node. A failure-recovery checkpoint of a state of the task node can be generated before all of the component tuples have been processed.