search

cloudflare / golz4

Golang interface to LZ4 compression
BSD 3-Clause "New" or "Revised" License
97 stars 32 forks source link

Framing Format Support #6

Open eapache opened 9 years ago

eapache commented 9 years ago

Similar to #4 but this is standardized now and part of the upstream project (as of r126) so it should be as simple as pulling in the new upstream code and writing another wrapper. We need this for https://github.com/Shopify/sarama/issues/256 if at all possible.

jgrahamc commented 9 years ago

Which functions do you need?

eapache commented 9 years ago

The functions in https://code.google.com/p/lz4/source/browse/trunk/lib/lz4frame.h?spec=svn126&r=126, although I think just LZ4F_compressFrame and LZ4F_decompress might be enough. It's hard to tell without experimentation since Kafka's documentation on exactly which framing options they used is rather incomplete.