FILE PROCESSING METHOD AND SYSTEM BASED ON ETL

摘要

A file processing method and system based on ETL, the method comprising: obtaining a plurality of file objects from a source end (101); for each file object, dividing data in a file to obtain a plurality of text data blocks (102); concurrently writing all the text data blocks corresponding to the plurality of file objects into a destination end after completing the division of the plurality of file objects (103). The method and system can increase the speed of file synchronization in the ETL process and maximize data synchronization efficiency.