tvl-depot/tvix/castore
Connor Brewster b0aaff25fa refactor(tvix/castore): extract concurrent blob uploader
The archive ingester has a mechanism for concurrently uploading small
blobs to the blob service in order to hide round trip latency with the
blob service when ingesting many small blobs.

Other ingestion sources like NARs also need a similar mechanism, this
extracts the concurrent blob uploading mechanism into its own struct to
make it more reusable.

Change-Id: I05020419ff4b9ad5829fbfb5cd08d36db983b8c0
Reviewed-on: https://cl.tvl.fyi/c/depot/+/11693
Tested-by: BuildkiteCI
Reviewed-by: flokli <flokli@flokli.de>
2024-05-20 15:21:46 +00:00
..
docs docs(tvix/castore/blobstore): reorganize docs 2024-02-06 18:28:00 +00:00
protos docs(tvix/castore/directorysvc): K/V is not necessarily flat 2024-02-20 09:17:38 +00:00
src refactor(tvix/castore): extract concurrent blob uploader 2024-05-20 15:21:46 +00:00
build.rs feat(tvix/castore): derive Eq and Hash automatically 2024-03-20 21:19:02 +00:00
Cargo.toml feat(tvix/store): add ObjectStoreDirectoryService 2024-05-16 16:33:06 +00:00
default.nix test(tvix/[ca]store): enable bigtable only with "integration" feature 2024-05-03 08:53:09 +00:00