Add zlib decompressor - Githubissues

airlift / aircompressor

A port of Snappy, LZO, LZ4, and Zstandard to Java

Apache License 2.0

562 stars 111 forks source link

Add zlib decompressor #155

Open electrum opened 1 year ago

electrum commented 9 months ago

This is currently several times slower than the JDK version that uses zlib, so I don't think we should merge this now.

Chaho12 commented 8 months ago

How did you test and got results several times slower? TPC-H benchmark? When I simply tested with this changes (note. i initialized with maxBuffersize), and did several tests with internal data including complex sqls with numerous joins, and simple ones with select count(*) from for reading orc zlib data, the results wasn't too bad. maximum of 20% slower?