SYSTEM AND METHOD TO MAXIMIZE SERVER RESOURCE UTILIZATION AND PERFORMANCE OF METADATA OPERATIONS

摘要

An MDS (metadata server) in a distributed storage system includes data servers (DSs) storing file contents and one or more MDSs performing metadata operations in response to metadata requests of different types, the MDS including a controller having a processor and a memory, the MDS storing file system metadata. The controller is configured to: classify the metadata operations into different categories, which include a normal category and one or more special categories different from the normal category, the normal category having a primary stage which does not involve communication between the MDS and a component external to the MDS; for each special category, partition each metadata operation into a plurality of stages at least one of which involves communication between the MDS and a component external to the MDS; and dynamically assign resources to each of the partitioned stage based on monitored workloads of the different types of metadata requests.

主权项

1. An MDS (metadata server) in a distributed storage system which includes a plurality of data servers (DSs) storing file contents and one or more MDSs performing a plurality of metadata operations in response to metadata requests of different types, the MDS including a controller having a processor and a memory, the MDS storing file system metadata, the controller being configured to:
classify the metadata operations into different categories, which include a normal category and one or more special categories which are different from the normal category, the normal category having a primary stage which does not involve communication between the MDS and a component external to the MDS; for each of the one or more special categories, partition each of the metadata operations into a plurality of stages at least one of which involves communication between the MDS and a component external to the MDS; and dynamically assign resources to each of the partitioned stage based on monitored workloads of the different types of metadata requests.