tvl-depot/users/flokli
Florian Klink e4adca0880 feat(users/flokli/nixos/archeology-ec2): automate bucket log parsing
This adds a `parse-bucket-logs.{service,timer}`, running once every
night at 3AM UTC, figuring out the last time it was run and parsing
bucket logs for all previous days.

It invokes the `archeology-parse-bucket-logs` script to produce
a .parquet file with the bucket logs in `s3://nix-cache-log/log/` for
that day (inside a temporary directory), then on success uploads the
produced parquet file to
`s3://nix-archeologist/nix-cache-bucket-logs/yyyy-mm-dd.parquet`.

Change-Id: Ia75ca8c43f8074fbaa34537ffdba68350c504e52
Reviewed-on: https://cl.tvl.fyi/c/depot/+/10011
Reviewed-by: edef <edef@edef.eu>
Tested-by: BuildkiteCI
2023-11-12 16:46:06 +00:00
..
archeology fix(users/flokli/archaeology): don't use file but column compression 2023-11-11 19:49:13 +00:00
nixos feat(users/flokli/nixos/archeology-ec2): automate bucket log parsing 2023-11-12 16:46:06 +00:00
presentations feat(users/flokli): add ASG Lightning talk presentation 2023-10-16 11:49:06 +00:00
keys.nix feat(ops/nixos/whitby): add flokli user 2021-03-26 20:31:48 +00:00
OWNERS chore(gerrit): migrate OWNERS files to code-owners style 2022-09-19 11:13:28 +00:00