GEOGRAPHICALLY-DISTRIBUTED FILE SYSTEM USING COORDINATED NAMESPACE REPLICATION OVER A WIDE AREA NETWORK

摘要

A cluster of nodes implements a single distributed file system comprises at least first and second data centers and a coordination engine process. The first data center may comprise first DataNodes configured to store data blocks of client files, and first NameNodes configured to update a state of a namespace of the cluster. The second data center, geographically remote from and coupled to the first data center by a wide area network, may comprise second DataNodes configured to store data blocks of client files, and second NameNodes configured to update the state of the namespace. The first and second NameNodes are configured to update the state of the namespace responsive to data blocks being written to the DataNodes. The coordination engine process spans the first and second NameNodes and coordinates updates to the namespace stored such that the state thereof is maintained consistent across the first and second data centers.

主权项

1. A cluster of nodes comprising computing devices configured to implement a single geographically-distributed file system, the cluster comprising:
a first data center, comprising:
a plurality of first DataNodes, each configured to store data blocks of client files;a plurality of first NameNodes each configured to update a state of a namespace of the cluster, a second data center that is geographically remote from and coupled to the first data center by a wide area network, the second data center comprising:
a plurality of second DataNodes, each configured to store data blocks of client files;a plurality of second NameNodes, each configured to update the state of the namespace, wherein the plurality of first and second NameNodes are configured to update the state of the namespace responsive to data blocks being written to the plurality of first and second DataNodes; and a coordination engine process spanning the plurality of first NameNodes and the plurality of second NameNodes, the coordination engine process being configured to coordinate updates to the state of the namespace stored by the plurality of first and second NameNodes such that the state of the namespace is maintained consistent across the first and second data centers of the cluster.