tvl-depot/tvix/glue
Connor Brewster 63116d8c21 fix(tvix): Avoid buffering file into memory in builtins.hashFile
Right now `builtins.hashFile` always reads the entire file into memory
before hashing, which is not ideal for large files. This replaces
`read_to_string` with `open_file` which allows calculating the hash of
the file without buffering it entirely into memory. Other callers can
continue to buffer into memory if they choose, but they still use the
`open_file` VM request and then call `read_to_string` or `read_to_end`
on the `std::io::Reader`.

Fixes b/380

Change-Id: Ifa1c8324bcee8f751604b0b449feab875c632fda
Reviewed-on: https://cl.tvl.fyi/c/depot/+/11236
Reviewed-by: flokli <flokli@flokli.de>
Tested-by: BuildkiteCI
2024-04-09 17:31:58 +00:00
..
benches revert(tvix): don't use Rc::clone explicitly 2024-02-21 18:36:11 +00:00
src fix(tvix): Avoid buffering file into memory in builtins.hashFile 2024-04-09 17:31:58 +00:00
Cargo.toml feat(tvix/glue): Add AsyncRead wrapper to decompress streams 2024-03-11 11:35:18 +00:00
default.nix feat(tvix/glue): Implement builtins.fetchurl 2024-03-11 02:21:54 +00:00