ecoppens/colmena
1
0
Fork 0
forked from DGNum/colmena
Code Pull requests Activity

manual/parallelism.md: Mention nix-eval-jobs support

Browse source
This commit is contained in:
Zhaofeng Li 2022-04-19 00:29:35 -07:00
parent ab754ac2e3
commit c509cc21ba
1 changed files with 10 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

11
manual/src/features/parallelism.md
View file

@ -2,7 +2,10 @@
Colmena is built from the ground up to support parallel deployments.
Evaluation, build, and deployment of node configurations can happen at the same time.
This parallelism can be controlled primarily through two flags:
## Configuration
The parallelism of Colmena can be controlled through two flags:
**`--limit <number>`**
@ -13,3 +16,9 @@ Number of hosts to deploy at once in the final step (pushing closures and activa
By default, Colmena will automatically determine the maximum number of nodes to evaluate at the same time according to available RAM.
This flag allows you to set the limit to a predetermined value.
## Parallel Evaluation (Experimental)
By default, Colmena evaluates nodes in batches according to available RAM using Nix's built-in single-threaded evaluator.
Experimental support is available for using [nix-eval-jobs](https://github.com/nix-community/nix-eval-jobs) as the evaluator.
When nix-eval-jobs is enabled via `--evaluator streaming`, evaluation is parallelized with deployment processes kicked off as individual nodes finish evaluating.