Virtual file system providing interface between analytics platform and physical file system

摘要

A virtual file system is arranged between a physical file system and an analytics platform comprising a plurality of compute nodes, and is configured to control movement of data between the analytics platform and the physical file system. For example, the virtual file system may be configured to present to the analytics platform a software application programming interface (API) through which the analytics platform accesses data stored in the physical file system. The analytics platform illustratively comprises a unified analytics platform that is configurable to support both database analytics and map-reduce analytics. In some embodiments, the physical file system comprises one or more of a Lustre file system, a Hadoop Distributed File System (HDFS) and a General Parallel File System (GPFS), and the virtual file system comprises a parallel log-structured file system (PLFS).

主权项

1. An apparatus comprising:
a physical file system; a virtual file system coupled to the physical file system; and an analytics platform comprising a plurality of compute nodes; wherein the virtual file system is configured to control movement of data between the analytics platform and the physical file system; wherein the analytics platform comprises a unified analytics platform operative in a first configuration to perform database analytics and operative in a second configuration to perform map-reduce analytics; and wherein the virtual file system is implemented using at least one processing device comprising a processor coupled to a memory.