Staged data migration between data sources and cloud-based storage network

摘要

Embodiments relate to systems and methods for staged data migration between data sources and a cloud-based storage network. In aspects, a user can maintain a user premise network including servers, clients, local area networks, data stores, and/or other network assets. An administrator or other user of the premise network may wish to extract data from the premise network and transfer that data payload to a set of host storage clouds to leverage cost, redundancy, consolidation, or other cloud advantages. A cloud data delivery (CDD) service can be established to stage the upload of the data payload to the set of host storage clouds using a set of managed or dedicated lines to the CDD service, and to the host storage clouds at network edge. The connections between the premise network/CDD service and CDD service/host storage clouds can be selected and/or optimized to provide high-bandwidth connections tailored to the schedule, cost, or other requirements of the data payload to be transported.

主权项

1. A method comprising:
receiving, by a processor of a data distribution system, an identification of a data payload to be transported from a data source in a user premise network to a set of host storage clouds, wherein the user premise network includes a set of premise servers; receiving, by the data distribution system from the user premise network, a set of transport parameters to transport the data payload, wherein the set of transport parameters comprises a data transport schedule, a bandwidth capacity requirement, and a cost specification; identifying a set of dedicated staging channels between the data source and the data distribution system; managing the transport of the data payload from the data source to the data distribution system in view of the set of transport parameters, wherein managing the transport of the data payload in view of the set of transport parameters comprises selecting channels from the set of dedicated staging channels in view of the set of transport parameters; initiating the transport of the data payload from the data source in the user premise network to the data distribution system over the selected channels; in response to initiating the transport, monitoring the transport of the data payload, wherein monitoring the transport of the data payload comprises validating the transported data payload to ensure integrity of the transported data payload; receiving the data payload by the data distribution system from the data source in the user premise network over the selected channels; storing the data payload for a time period in a set of staged data stores of the data distribution system, wherein the set of staged data stores comprises servers located within geographic proximity of one of the user premise network or the set of host storage clouds, and wherein during the time period, the data distribution system is to communicate with the user premise network to interrogate the data source for updates to the data payload and to incorporate the updates into the data payload stored in the set of staged data stores of the data distribution system; applying an access control to govern access to the data payload while the data payload is stored in the set of staged data stores of the data distribution system; identifying a set of dedicated transport channels between the data distribution system and the set of host storage clouds in view of the set of transport parameters; and initiating the transport of the data payload from the data distribution system to the set of host storage clouds via the set of dedicated transport channels to store the data payload in a set of local cloud data stores of the set of host storage clouds.