Dynamic allocation of a high-speed memory pool between a cluster file system and a burst buffer appliance

摘要

An apparatus comprises a cluster file system, a burst buffer appliance coupled to the cluster file system, a high-speed memory pool configured for allocation between the cluster file system and the burst buffer appliance, and a controller associated with the high-speed memory pool and configured to dynamically adapt portions thereof between utilization as object storage servers of the cluster file system and utilization as burst buffers of the burst buffer appliance. By way of example, the high-speed memory pool comprises a plurality of flash servers that are reconfigurable between utilization as respective ones of the object storage servers of the cluster file system and utilization as respective ones of the burst buffers of the burst buffer appliance. The controller is configured to dynamically adapt the flash servers between utilization as respective object storage servers of the cluster file system and utilization as respective burst buffers of the burst buffer appliance.

主权项

1. An apparatus comprising: a cluster file system; a burst buffer appliance coupled to the cluster file system;
a high-speed memory pool configured for allocation between the cluster file system and the burst buffer appliance; and a controller associated with the high-speed memory pool and configured to dynamically adapt portions thereof between utilization as object storage servers of the cluster file system and utilization as burst buffers of the burst buffer appliance; wherein a given one of the portions of the high-speed memory pool is configured for utilization as at least a portion of one or more of the object storage servers of the cluster file system under a first set of operating conditions and the same given portion is configured for utilization as at least a portion of one or more of the burst buffers of the burst buffer appliance under a second set of operating conditions different than the first set of operating conditions; wherein the controller changes allocation of the same given portion of the high-speed memory pool from the cluster file system to the burst buffer appliance responsive to a change from the first set of operating conditions to the second set of operating conditions; wherein the burst buffer appliance is adapted for coupling between at least a portion of the cluster file system and one or more compute nodes of a computer system; wherein at least two of input-output performance, checkpoint duration and power consumption of the one or more compute nodes of the computer system are monitored; and wherein the controller is configured to detect the change from the first set of operating conditions to the second set of operating conditions based, at least in part, on a result of the monitoring.