FAULT TOLERANT DISTRIBUTED JOB SCHEDULER

摘要

Methods and systems for managing, storing, and serving data within a virtualized environment are described. In some embodiments, a data management system may manage the extraction and storage of virtual machine snapshots, provide near instantaneous restoration of a virtual machine or one or more files located on the virtual machine, and enable secondary workloads to directly use the data management system as a primary storage target to read or modify past versions of data. The data management system may allow a virtual machine snapshot of a virtual machine stored within the system to be directly mounted to enable substantially instantaneous virtual machine recovery of the virtual machine.

主权项

1. A method for operating a data management system, comprising:
storing one or more snapshots of a virtual machine as a set of files using a distributed file system, the distributed file system replicates the set of files among a plurality of nodes within a cluster; determining a first job associated with the virtual machine to be performed using a distributed job scheduler, the distributed job scheduler comprises a plurality of job scheduling processes running on the plurality of nodes, each node of the plurality of nodes runs one of the plurality of job scheduling processes; determining that a first node of the plurality of nodes stores the set of files; and running the first job on the first node in response to determining that the first node stores the set of files.