Dynamic mapping of extensible datasets to relational database schemas

摘要

A text file is received. The text file is arranged in an extensible format and includes a plurality of metadata lines, a header line, and a plurality of content lines. Keys are retrieved from the content lines. For each key, a data type and a number from at least one metadata table is retrieved. Using a combination of each key and the corresponding data type and number, a column title is derived. Upon verification that the derived column title does not already exist, a column for each key is generated in a content table having a dynamic structure in a relational database schema. The column has the derived column title, a column type based on the corresponding retrieved data type, and the number of generated columns determined by the corresponding retrieved number. The retrieved value is mapped into the column associated with the corresponding key.

主权项

1. A computer implemented method comprising:
receiving data comprising a text file, the text file being arranged in an extensible format and comprising a plurality of metadata lines, a header line, and a plurality of content lines; generating a content table storing data from at least a portion of the plurality of content lines, the content table having a dynamic structure in a relational database scheme, and the generating comprising: retrieving, from one of the plurality of content lines, a key; determining, based at least on the plurality of metadata lines, a data type and a number corresponding to the key retrieved from the one of the plurality of content lines; deriving, based at least on the key, the data type, and/or the number, a column title; adding, to the content table, a column for the key, the column being generated upon verification that the column title does not already exist, the column having the column title and storing data having the data type corresponding to the key, and a number of columns added to the content table corresponding to the number corresponding to the key; retrieving, from the one of the plurality of content lines, at least one value corresponding to the key; and mapping, into the column, the at least one value, the mapping comprising storing the at least one value in the column.