| 摘要 |
In one embodiment, a method includes using an owner gateway node to write data for a fileset, determining whether to utilize other gateway nodes to handle a portion of write traffic for the fileset, selecting a set of eligible gateway nodes based on: a current internal workload, a network workload, and recent performance history data in regard to workload distribution across the other gateway nodes, assigning and defining a size for one or more write task items for each gateway node in the set based on a current dynamic profile of each gateway node, providing availability to in-memory and/or I/O resources at each gateway node in the set to handle assigned write task items, and distributing workload to the set of eligible gateway nodes according to the size for each of the assigned write task items for each individual gateway node in the set of eligible gateway nodes. |
| 主权项 |
1. A computer program product for providing parallel writing in a clustered file system having cache storage, the computer program product comprising a non-transitory computer readable storage medium having program code embodied therewith, the program code executable by a processor to cause the processor to:
write, by the processor, data for a first fileset using an owner gateway (GW) node; determine, by the processor, whether to utilize one or more other GW nodes to handle at least a portion of write traffic for the first fileset; select, by the processor, a set of eligible GW nodes based on at least one of: a current internal workload, a network workload, and recent performance history data in regard to workload distribution across the one or more other GW nodes; assign and define, by the processor, a size for one or more write task items for each GW node in the set of eligible GW nodes based on a current dynamic profile of each individual GW node in the set of eligible GW nodes; provide, by the processor, availability to in-memory and input/output (I/O) resources at the each GW node in the set of eligible GW nodes to handle one or more assigned write task items; distribute, by the processor, workload to the set of eligible GW nodes according to the size for each of the one or more assigned write task items for the each individual GW node in the set of eligible GW nodes; receive, by the processor, a write operation from an application node, the received write operation including a file identifier, a start offset value, and an end offset value related to the one or more write task items; search, by the processor, a write queue to determine whether a write message for the file identifier is already in the write queue; merge, by the processor, any already-queued write messages with the received write operation in response to a determination that the file identifier is already in the write queue and write chunks are overlapping for the already-queued write messages and the received write operation; and prepare, by the processor, a scatter-gather list including write chunk information for the received write operation in response to a determination that the file identifier is not already in the write queue. |
