search

airlift / aircompressor

A port of Snappy, LZO, LZ4, and Zstandard to Java
Apache License 2.0
562 stars 111 forks source link

Zstd Hadoop compression codec? #109

Closed vvvvalvalval closed 1 year ago

vvvvalvalval commented 4 years ago

AFAICT, there is no Hadoop codec for Zstd in this library, despite what the README says, is this correct?

syed72 commented 4 years ago

Any idea, when Zstd Hadoop compression codec will be released?

findepi commented 4 years ago

To the best of my knowledge no-one is currently working on it. In Presto we use ZSTD compressor directly.

electrum commented 4 years ago

@Praveen2112 is working on this.

jackluo923 commented 2 years ago

@syed72 @vvvvalvalval Would you be interesting in testing out a version of ZstdHadoopCompressionCodec? Implementing it on top of Issue-138 should be relatively straightforward.

dain commented 1 year ago

This was implemented in #152