tvl-depot/ops/pipelines
Vincent Ambo 38ec27e834 fix(ops/pipelines): Chunk build pipeline into multiple uploads
The number of jobs in the depot pipeline is reaching the limits of the
Buildkite backend's ability for a single pipeline upload. Based on a
conversation with their support my understanding is that this has to
do with internal locking mechanisms at Buildkite.

To work around this, we can instead chunk the pipeline into several
smaller chunks that are uploaded serially.

This commit introduces logic to chunk the pipeline accordingly. The
chunk size chosen is 256 for now (a multiple of our number of agents,
which is useful if we can get builds from the first chunk to start
before the next ones are uploaded).

Note that this chunk size is significantly below even the current
number of targets (~460 as of this commit), but choosing a lower chunk
size might alleviate problems we've been seeing with timeouts during
pipeline uploads.

Change-Id: I77030aaf8b874c330218b78c77d15216e13b9af7
Reviewed-on: https://cl.tvl.fyi/c/depot/+/4332
Tested-by: BuildkiteCI
Reviewed-by: wpcarro <wpcarro@gmail.com>
Autosubmit: tazjin <mail@tazj.in>
2021-12-15 15:49:40 +00:00
..
depot.nix fix(ops/pipelines): Chunk build pipeline into multiple uploads 2021-12-15 15:49:40 +00:00
README.md docs: Update README for the repository itself 2020-08-17 21:52:58 +00:00
static-pipeline.yaml fix(ops/pipelines): Chunk build pipeline into multiple uploads 2021-12-15 15:49:40 +00:00

This folder contains the dynamic configuration for our Buildkite CI setup.

The configuration is built and dynamically loaded by Buildkite at the start of each CI pipeline.