apache / arrow-nanoarrow

Helpers for Arrow C Data & Arrow C Stream interfaces
https://arrow.apache.org/nanoarrow
Apache License 2.0
174 stars 38 forks source link

Support per-buffer compression in the IPC reader #621

Open paleolimbot opened 2 months ago

paleolimbot commented 2 months ago

We don't currently support buffer-level compression when reading IPC streams, although there is some infrastructure in the reader that was designed to eventually support it. Given that the IPC reader (and the nanoarrow bindings that use it) might be handed an arbitrary stream from elsewhere, it would be beneficial to have this be supported.