Systems and methods of data storage management, such as dynamic data stream allocation

摘要

A system and method for choosing a stream to transfer data is described. In some cases, the system reviews running data storage operations and chooses a data stream based on the review. In some cases, the system chooses a stream based on the load of data to be transferred.

主权项

1. A method of transferring data to one or more storage media, the method comprising:
identifying data to be transferred to the one or more storage media; receiving data transfer information associated with two or more data streams in a process of transferring the identified data to the one or more storage media, wherein the data transfer information comprises an amount of data currently being transferred by each of the two or more data streams and a data transfer rate of each of the two or more data streams; selecting from the two or more data streams a data stream based at least in part on the received data transfer information; pre-allocating space on the one or more storage media associated with the selected data stream; storing, at a first time, the identified data to be transferred in a first queue associated with the selected data stream; reassigning, at a second time later than the first time, the identified data to be transferred from the first queue to a second queue associated with a data stream other than the selected data stream, wherein the reassigning compensates for changing amounts of data being transferred by each of the two or more data streams, and the data transfer rates of each of the two or more data streams; and transferring the identified data to be transferred to the pre-allocated space.