[Java] Compression closes uncompressed buffers

apache / arrow

Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing

https://arrow.apache.org/

Apache License 2.0

13.98k stars 3.41k forks source link

[Java] Compression closes uncompressed buffers #33337

Open asfimport opened 1 year ago

asfimport commented 1 year ago

AbstractCompressionCodec closes underlying uncompressedBuffer which leads to closed buffers in VectorSchemaRoot via {}VectorUnloader{}. There isn't such behavior in NoCompressionCodec passing underlying buffers untouched.

Reporter: Michal Zaborec

_{Note: This issue was originally created as ARROW-18142. Please see the migration documentation for further details.}

asfimport commented 1 year ago

Antoine Pitrou / @pitrou: cc @lwhite1

asfimport commented 1 year ago

Michal Zaborec: The whole interaction with ArrowWriter looks weird. It seems that newly allocated compressed buffers aren't closed at all.