tvl-depot/tvix/castore
Florian Klink 82f8ce8b7d feat(tvix/castore/blobsvc/grpc): read data in chunks
Whenever this encounters an open_read(), it'll first check for more
granular chunking. If there's more granular chunking data available, a
ChunkedReader is constructed (which supports seeking backwards).

This currently is still a bit stupid, and doesn't compose, as
`ChunkedReader` uses `self` as the `BlobService` to ask for the
individual chunks.

In store composition future, we might want to compose this differently,
essentially constructing `ChunkedReader` with another `BlobService`
representing the entire hierarchy, so there's a chance to locally cache
things, and do less requests.

Change-Id: I22e0df4d6245f666d083b4f0b7114d3ac41d1dce
Reviewed-on: https://cl.tvl.fyi/c/depot/+/11185
Tested-by: BuildkiteCI
Reviewed-by: Connor Brewster <cbrewster@hey.com>
2024-03-18 16:10:05 +00:00
..
docs docs(tvix/castore/blobstore): reorganize docs 2024-02-06 18:28:00 +00:00
protos docs(tvix/castore/directorysvc): K/V is not necessarily flat 2024-02-20 09:17:38 +00:00
src feat(tvix/castore/blobsvc/grpc): read data in chunks 2024-03-18 16:10:05 +00:00
build.rs fix(tvix): don't emit rerun-if-changed 2024-03-16 09:34:10 +00:00
Cargo.toml chore(tvix): bump tonic to 0.11.0 2024-03-16 17:04:12 +00:00
default.nix fix(tvix/castore): also set SSL_CERT_FILE for tests there 2024-03-03 17:43:42 +00:00