Method and system for transforming input data streams

摘要

A system and method for processing an input data stream in a first data format of a plurality of first data formats to an output data stream in a second data format of a plurality of second data formats. A plurality of input connector modules receive respective input data streams and at least one input queue stores the received input data streams. A plurality of job threads is operatively connected to the at least one input queue, each job thread formatting a stored input data stream to produce an output data stream. At least one output queue stores the output data streams from the plurality of job threads. A plurality of output connector modules is operatively connected to the at least one output queue, the output connector modules supplying respective output data streams.

主权项

1. A system for transforming input data streams comprising:
a physical input connector; a physical output connector; a processing system coupled to the physical input connector and the physical output connector, the processing system including a computer program product to:
read an electronic input data stream received at the physical input connector, wherein input data in the input data stream is of a first format; and in a same thread:
identify one or more events based on a detected pattern or a detected sequence in the input data stream;create a message for each identified event, the message containing data from the event;create output data of a second format from the message, the output data containing the data from the message, wherein the second format is a different format from the first format; andprovide an output data stream via the physical output connector, the output data stream comprising the output data.