Data processing performance enhancement in a distributed file system

摘要

Systems and methods of data processing performance enhancement are disclosed. One embodiment includes, invoking operating system calls to optimize cache management by an I/O component; wherein, the operating system calls are invoked to perform one or more of; proactive triggering of readaheads for sequential read requests of a disk; purging data out of buffer cache after writing to the disk or performing sequential reads from the desk; and/or eliminating a delay between when a write is performed and when written data from the write is flushed to the disk from the buffer cache.

主权项

1. A method for enhancing performance for data processing in a distributed file system, the method comprising:
instantiating an input/output (I/O) manager on a machine among a plurality of machines that implement the distributed file system; and utilizing the I/O manager to perform cache management optimization selected from the group consisting of (a) deterministically triggering readaheads for all sequential read requests by overriding a heuristic for the readaheads on the machine; (b) instructing the machine to invalidate cached data in a buffer upon detecting that a specific size of data has been automatically cached; and (c) overriding a time delay configured on the machine so that the machine is to commit data from the buffer to a disk without the time delay.