Optimization of job scheduling in a computing environment

摘要

Optimizing job scheduling in a data processing system includes determining a time factor associated with a report, determining one or more jobs that contribute to the report, and narrowing execution frequency of the one or more jobs based on the time factor of the report. The time factor provides information about timing details for data included in the report. The jobs are executed in a computing environment according to a time schedule.

主权项

1. A method for optimizing job scheduling in a data processing system executed on a processor, the method comprising:
determining a time factor associated with a report, wherein the time factor provides information about timing details for data included in the report; determining jobs that contribute to the report, the jobs executed in a computing environment according to a time schedule, wherein the determining the jobs that contribute to the report includes collecting timeline-related metadata from the jobs and generating one or more data lineage graphs, each of data lineage graphs includes information identifying relationships between the report and the jobs that are utilized to generate the report; and narrowing execution frequency of at least one of the jobs based on the time factor of the report.