Method and Apparatus for Accelerated Data Translation Using Record Layout Detection

摘要

Various methods and apparatuses are described for performing high speed translations of data. In an example embodiment, record layout detection can be performed for data. In another example embodiment, data pivoting prior to field-specific data processing can be performed.

主权项

1. A method comprising;
receiving a plurality of records, the records having a first format, but exhibiting a plurality of different record layouts for the first format; analyzing the records to determine their record layouts; streaming the records and data indicative of their determined record layouts through a processing pipeline; the processing pipeline translating the records to a second format based in part on the data indicative of the records' determined record layouts; and wherein the method steps are performed by a processor.