Distributed file system gateway

摘要

Technology is disclosed for managing data in a distributed file system (“the technology”). The technology can gather metadata information associated with the data stored within a first file system, store the metadata information in association with a data identifier within a second file system, retrieve the stored metadata information using the data identifier from within the second file system and locate and retrieve the data associated with the metadata information from within first file system.

主权项

1. A method, comprising:
receiving a request, by a data node server, to access data through a first distributed file system, the request including a first data identifier associated with the data for accessing the data through the first distributed file system; wherein the received first data identifier is used by the data node server to determine that data associated with the first identifier has been evicted from the first distributed file system; identifying, utilizing the received first data identifier, a second data identifier associated with the data identified as being evicted from the first file system, the second data identifier being stored within the first distributed file system and utilized for generating a request for accessing the data evicted from the first file system and stored within a second distributed file system; retrieving, utilizing the identified second data identifier, the data from within the second distributed file system; removing any indication that the data retrieved from the second distributed file system has been evicted from the first distributed file system; converting the retrieved data from a first format of the second distributed file system to a second format of the first distributed file system; storing, by a gateway manager in the data node server, the converted data within the first distributed file system, wherein the stored data is retrieved from within the first distributed file system in response to another request for the data; and providing access to the converted retrieved data through the first distributed file system.