<p>Among other aspects disclosed are a method and system for processing a batch of input data in a fault tolerant manner. The method includes reading a batch of input data including a plurality of records from one or more data sources and passing the batch through a dataflow graph. The dataflow graph includes two or more nodes representing components connected by links representing flows of data between the components. At least one but fewer than all of the components includes a checkpoint process for an action performed for each of multiple units of work associated with one or more of the records. The checkpoint process includes opening a checkpoint buffer stored in non-volatile memory at the start of processing for the batch.</p>
申请公布号
EP2454666(A4)
申请公布日期
2013.04.24
申请号
EP20100800408
申请日期
2010.07.13
申请人
AB INITIO TECHNOLOGY LLC
发明人
DOUROS, BRYAN, PHIL;ATTERBURY, MATTHEW, DARCY;WAKELING, TIM