DOUBLE BUFFERING WITH ATOMIC TRANSACTIONS FOR THE PERSISTENT STORAGE OF REAL-TIME DATA FLOWS

摘要

A method, including configuring, in a memory, a first buffer to store first buffer data, a second buffer to store second buffer data, and a variable indicative of a persisted size of real-time data persisted to a storage device. On the storage device, a file is configured to store the real-time data and a field is configured to store the variable. A stream of the real-time data is received, and the stream is appended to the first buffer data. Upon meeting a write criteria, the first buffer data in is swapped with the second buffer data, a buffer size of the second buffer data is added to the variable, and the second buffer data is conveyed from the second buffer to a write cache. Upon meeting a commit criteria, the stream stored in the write cache is appended to the file, and the variable is persisted to the field.

主权项

1. A method for storing real-time data, comprising:
configuring, in a memory, a first buffer to store first buffer data, a second buffer to store second buffer data, and a variable indicative of a persisted size of the real-time data persisted to a storage device; configuring, on the storage device, a file to store the real-time data and a field to store the variable; receiving, by a processor, a stream of the real-time data; appending the stream of the real-time data to the first buffer data; upon meeting a write criteria:
swapping the first buffer data in the first buffer with the second buffer data in the second buffer;adding a buffer size of the second buffer data in the second buffer to the variable; andcalling a write function to convey the second buffer data from the second buffer to a write cache; and upon meeting a commit criteria:
calling a commit function to append the stream of the real-time data stored in the write cache to the file; andpersisting the variable to the field.