Implement zstdfile() connection

coolbutuseless / zstdlite

Fast, configurable in-memory compression of R objects with zstd

Other

26 stars 0 forks source link

Closed coolbutuseless closed 5 months ago

coolbutuseless commented 5 months ago

Implement a zstdfile() connection (like gzfile(), url() etc).

coolbutuseless commented 5 months ago

First draft done.

Remaining issues:

[x] readLines() with zstdfile() has a segfault on ubuntu
- Fixed. Need to clone va_list if using it twice.
[x] Can I get auto-close behaviour when usring R serialize()? How does gzfile() behave here?
- serialize() doesn't auto-close the connection. need to do an explicit close. Even with gzfile()
[x] Can I mimic the auto-close behaviour which is done using contexts in the base R connections?
- Doesn't seem likely.

coolbutuseless commented 5 months ago

Basic implementation done (2024-04-15).