MANAGING HIGHLY SCALABLE CONTINUOUS DELIVERY PIPELINES

摘要

Systems and methods are provided for managing and tracking process pipelines and other flows in a way that reduces the requirement for a central controlling process to manage every step of the associated pipeline flow and the state associated with each running instance. Job information and pipeline state are tracked by each worker involved in the pipeline. This enables some key capabilities within these process pipelines such as dynamic process re-writing and cross security domain job execution.

主权项

1. A method, comprising:
sending, by a computing system, a job package to a first build worker in response to launching a build pipeline, an entire plan for the build pipeline being written into the job package; receiving, by the computing system, first results of a first job in the build pipeline performed by the first build worker, a first transactional record associated with the first results being maintained within a first build record held by the first build worker; receiving, by the computing system, second results of a second job in the build pipeline performed by a second build worker, a second transactional record associated with the second results being maintained within a second build record held by the second build worker; and updating, by the computing system, the first build record held by the first build worker with the second results of the second job in the build pipeline performed by the second build worker.