| 主权项 |
1. A computer data system for importing and presenting data for a computer system having cache memory buffers, persistent storage, and a listener device, the computer data system comprising
one or more processors; computer readable storage coupled to the one or more processors, the computer readable storage having stored thereon instructions that, when executed by the one or more processors, cause the one or more processors to perform operations including: starting a logging process to receive a stream of data; creating in a computer memory device one or more log files; starting a log tailer process for reading data from the one or more log files and transmitting data read from log files; starting a listener to parse received log data to be appended to columns; receiving a stream of data by the logging process; the logging process writing the data into the one or more log files in a computer memory; the log tailer process reading data from the one or more log files; the log tailer process transmitting the data to one or more data import servers; parsing the data with the listener; at the one or more data import servers, writing the data to one or more columns of the associated table location in cache memory buffers, for immediate use by data consumers and for writing to persistent storage; confirming, at the one or more data import servers, a current number of rows of data written to the cache memory buffers; synchronizing, at the one or more data import servers, the column data from the cache memory buffers into a persistent table data store; updating, at the one or more data import servers, table location metadata; and writing a check point for the persisted data for use in resuming import after a system fault. |
