The dgnum infrastructure
Find a file
DGNum Chores 21823b0da2
Some checks failed
Check meta / check_meta (push) Successful in 2m8s
Check meta / check_meta (pull_request) Successful in 2m16s
Check meta / check_dns (push) Successful in 2m16s
Check meta / check_dns (pull_request) Successful in 2m16s
lint / check (push) Successful in 2m22s
build configuration / build_krz01 (pull_request) Failing after 5m41s
build configuration / push_to_cache_krz01 (pull_request) Has been skipped
build configuration / build_storage01 (pull_request) Failing after 4m23s
build configuration / push_to_cache_storage01 (pull_request) Has been skipped
build configuration / build_rescue01 (pull_request) Failing after 1m10s
build configuration / push_to_cache_rescue01 (pull_request) Has been skipped
build configuration / build_compute01 (pull_request) Successful in 12m41s
build configuration / build_web01 (pull_request) Successful in 12m32s
build configuration / build_geo02 (pull_request) Successful in 7m48s
build configuration / build_web02 (pull_request) Successful in 12m27s
build configuration / build_geo01 (pull_request) Successful in 8m12s
build configuration / build_vault01 (pull_request) Successful in 12m37s
lint / check (pull_request) Successful in 24s
build configuration / build_bridge01 (pull_request) Successful in 1m13s
build configuration / push_to_cache_geo02 (pull_request) Successful in 1m51s
build configuration / push_to_cache_web02 (pull_request) Successful in 1m52s
build configuration / push_to_cache_geo01 (pull_request) Successful in 1m34s
build configuration / push_to_cache_compute01 (pull_request) Successful in 2m8s
build configuration / push_to_cache_web01 (pull_request) Successful in 2m15s
build configuration / push_to_cache_vault01 (pull_request) Successful in 1m28s
build configuration / push_to_cache_bridge01 (pull_request) Successful in 1m6s
chore(npins): Update
2024-10-09 13:29:45 +00:00
.forgejo/workflows feat(workflows/eval): Add krz01 to the CI 2024-10-08 14:15:01 +02:00
iso feat(iso): Use latest kernel, and support bcachefs at installation 2024-09-20 23:37:01 +02:00
keys feat(krz01): init 2024-10-08 12:35:59 +02:00
lib chore(nix-patches): Add helper function 2024-10-08 20:49:26 +02:00
machines feat(krz01): finish ollama integration and whisper.cpp 2024-10-09 13:59:05 +02:00
meta feat(krz01): move to unstable 2024-10-09 12:51:14 +02:00
modules feat(krz01): add basic microvm exprs 2024-10-08 17:14:23 +02:00
npins chore(npins): Update 2024-10-09 13:29:45 +00:00
patches fix(krz01): apply a correctness patch on proxmox-nixos 2024-10-08 20:49:41 +02:00
scripts feat(attic): Bye bye attic 2024-10-06 18:33:04 +02:00
.envrc Use direnv 2023-05-22 15:08:43 +02:00
.gitignore fix(infra): remove untrackable file 2024-02-17 22:56:25 +01:00
CONTRIBUTE.md feat(README): Add guidelines for contributions and doc for dev tools 2024-02-23 21:07:20 +01:00
default.nix fix(cache): Make instructions and code work 2024-10-08 15:50:21 +02:00
hive.nix chore(nix-patches): Add helper function 2024-10-08 20:49:26 +02:00
LICENSE keys: Separate keys and move them 2023-05-22 15:05:12 +02:00
README.md fix(cache): Make instructions and code work 2024-10-08 15:50:21 +02:00
shell.nix fix(npins): Update the version used 2024-07-11 10:33:01 +02:00

❄️ infrastructure

The dgnum infrastructure.

Contributing

Some instruction on how to contribute are available (in french) in /CONTRIBUTE.md. You're expected to read this document before commiting to the repo.

Some documentation for the development tools are provided in the aforementioned file.

Using the binary cache

Add the following module to your configuration (and pin this repo using your favorite tool: npins, lon, etc...):

{ lib, ... }:
let
  dgnum-infra = PINNED_PATH_TO_INFRA;
in {
  nix.settings = (import dgnum-infra { }).mkCacheSettings {
    caches = [ "infra" ];
  };
}

Adding a new machine

The first step is to create a minimal viable NixOS host, using tha means necessary. The second step is to find a name for this host, it must be unique from the other hosts.

Tip

For the rest of this part, we assume that the host is named host02

Download the keys

The public SSH keys of host02 have to be saved to keys/machines/host02.keys, preferably only the ssh-ed25519 one.

It can be retreived with :

ssh-keyscan address.of.host02 2>/dev/null | awk '/ssh-ed25519/ {print $2,$3}'

Initialize the machine folder and configuration

  • Create a folder host02 under machines/
  • Copy the hardware configuration file generated by nixos-generate-config to machines/host02/_hardware-configuration.nix
  • Create a machines/host02/_configuration.nix file, it will contain the main configuration options, the basic content of this file should be the following
{ lib, ... }:

lib.extra.mkConfig {
  enabledModules = [
    # List of modules to enable
  ];

  enabledServices = [
    # List of services to enable
  ];

  extraConfig = {
    services.netbird.enable = true;
  };

  root = ./.;
}

Fill in the metadata

Network configuration

The network is declared in meta/network.nix, the necessary hostId value can be generated with :

head -c4 /dev/urandom | od -A none -t x4 | sed 's/ //'

Other details

The general metadata is declared in meta/nodes.nix, the main values to declare are :

  • site, where the node is physically located
  • stateVersion
  • nixpkgs, the nixpkgs version to use

Initialize secrets

Create the directory secrets in the configuration folder, and add a secrets.nix file containing :

let
  lib = import ../../../lib { };
in

lib.setDefault { publicKeys = lib.getNodeKeys "host02"; } [ ]

This will be used for future secret management.

Update encrypted files

Both the Arkheon, Netbox and notification modules have secrets that are deployed on all machines. To make those services work correctly, run in modules/dgn-records, modules/dgn-netbox-agent and modules/dgn-notify :

agenix -r

Commit and create a PR

Once all of this is done, check that the configuration builds correctly :

colmena build --on host02

Apply it, and create a Pull Request.