Data merge based on logical segregation

摘要

Described herein are systems, computer readable mediums, and methods for merging a source file with a target table using different merging processes. The source file may be logically segregated into new records and update records. The update records may be logically segregated into a first update record section and a second update record section. The target table may be logically segregated into a target table section. In one implementation, a server may use a hash merging process to merge the first update record section with the target table section and use an index merging process to merge the second update record section with the target table.

主权项

1. A computer readable medium storing instructions, which when executed by a processor, cause the processor to perform actions comprising:
logically segregating a source file into new record data and update record data, the new record data comprising new records for a target table, the update record data comprising update records which comprise updates for the target table, the update records being associated with update record dates; inserting the new records into the target table; logically segregating the update record data into a first update record section and a second update record section, the first update record section including a first number of the update records, the second update record section including a second number of the update records; determining a cutoff date, the cutoff date being associated with one or more of the update records of the first update record section; accessing the target table, the target table comprising target table records associated with target table dates, the target table records comprising transactions; using the cutoff date, determining a target table section, the target table section including a third number of the target table records which are associated with dates between a designated date and the cutoff date, the designated date being after the cutoff date; using a first merging process, merging the first update record section with the target table section; and using a second merging process, merging the second update record section with the target table.