Multi-row database data loading for enterprise workflow application

摘要

Embodiments of the invention are directed to a system, method, or computer program product for providing expedited loading/inserting of data by an entity. Specifically, the invention expedites the loading/inserting of large quantities of data to database tables. Initially received data for loading is processed, via multi-row insert, onto in-memory or temporary tables. The data is staged on a temporary table while the appropriate base table is determined. Once determined, data from the temporary table is pointed to the base table. In this way, a massive amount of data loading from the temporary table to a base table may occur. This prevents logging and locking associated with adding individual data points or row to a base table independently. Errors are check and processed accordingly. Once updated, the data on the temporary table is deleted in mass and a check point restart is issued.

主权项

1. A system for loading data to an entity database, the system comprising:
a memory device with computer-readable program code stored thereon; a communication device; a processing device operatively coupled to the memory device and the communication device, wherein the processing device is configured to execute the computer-readable program code to:
receive data for storage on the entity database, wherein the data on the entity database is stored in base tables and configured in rows;read parameters from the received data for storage on the entity database;present a temporary table to store the received data based on the data parameters;insert the received data onto the temporary table, wherein the insertion of the received data is done by multi-row insertion;stage the data on the temporary table, wherein the temporary table is visible to all sessions but the staged data on the temporary table is only visible to a session that inserts the received data onto the temporary table;identify one or more appropriate base tables for the received data to be stored, wherein the appropriate base table is based in part on a type of data already stored on the appropriate base table;insert the received data from the temporary table to the appropriate base table, wherein the insertion of all the data on the temporary table is completed using a single insert statement;confirm that the received data is inserted correctly on the appropriate base table; anddelete, in mass, the received data from the temporary table based at least in part on the confirming that the received data is inserted correctly on the appropriate base table.