METHOD AND SYSTEM FOR TRANSFORMING INPUT DATA STREAMS

摘要

A system and method for processing an input data stream. An input connector module receives an input data streams. A job thread is operatively connected to the received input data stream and produces an output data stream. An output connector module supplies an output data stream.

主权项

1. A system for processing input data streams comprising:
an input connector; an output connector; a processing system coupled to the input connector and the output connector, the processing system configured to:
read an electronic input data stream of file data received at the input connector;detect patterns in the input data stream to identify events;create a message for each event, the message containing data associated with the event according to a generic data structure corresponding to the event;execute a process configured to create generate a meta record based on the message and send the meta record to an output pipeline; andprovide an output data stream to a destination from the output pipeline via the output connector, wherein at least a portion of the output data stream contains data from the message converted according to the meta record.