Optimized multi-component co-allocation scheduling with advanced reservations for data transfers and distributed jobs

摘要

Disclosed are systems, methods, computer readable media, and compute environments for establishing a schedule for processing a job in a distributed compute environment. The method embodiment comprises converting a topology of a compute environment to a plurality of endpoint-to-endpoint paths, based on the plurality of endpoint-to-endpoint paths, mapping each replica resource of a plurality of resources to one or more endpoints where each respective resource is available, iteratively identifying schedule costs associated with a relationship between endpoints and resources, and committing a selected schedule cost from the identified schedule costs for processing a job in the compute environment.

主权项

1. A method comprising:
converting a topology of first compute resources in a computer environment to a plurality of endpoint-to-endpoint paths; based on the plurality of endpoint-to-endpoint paths, mapping each replica resource of the first compute resources to at least one endpoint compute to yield mapped replica resources; based on the mapped replica resources, evaluating resources in the computer environment to yield identified schedule costs; receiving a request to use second compute resources of the first compute resources to process a workload; and using the second compute resources for the workload based on the identified schedule costs.