File load times with dynamic storage usage

摘要

Provided is a technique for improving file load times with dynamic storage usage. A file made up of data blocks is received. A list of storage devices is retrieved. In one or more iterations, the data blocks of the file are written by: updating the list of storage devices by removing any storage devices with insufficient space to store additional data blocks; generating a performance score for each of the storage devices in the updated list of storage devices; determining a portion of the data blocks to be written to each of the storage devices based on the generated performance score for each of the storage devices; writing, in parallel, the determined portion of the data blocks to each of the storage devices; and recording placement information indicating the storage devices to which each determined portion of the data blocks was written.

主权项

1. A method, comprising:
receiving, with a processor of a computer, a file made up of data blocks; retrieving a list of storage devices; and in one or more iterations, writing the data blocks of the file by:
updating the list of storage devices by removing any storage devices with insufficient space to store additional data blocks;generating a performance score for each of the storage devices in the updated list of storage devices;determining a portion of the data blocks to be written to each of the storage devices based on the generated performance score for each of the storage devices;writing, in parallel, the determined portion of the data blocks to each of the storage devices; andrecording placement information indicating the storage devices to which each determined portion of the data blocks was written.