search

awr / KafkaClient

Native C# client for Kafka
Apache License 2.0
5 stars 2 forks source link

Add Snappy & Lz4 Compression #12

Open awr opened 7 years ago

awr commented 7 years ago

Currently, only gzip is supported.

awr commented 7 years ago

Consider using https://github.com/Kintaro/SnappySharp for the compression.

awr commented 7 years ago

Another option is https://github.com/jeffesp/Snappy.Sharp, but there are concerning open issues wrt data not lining up (see https://github.com/jeffesp/Snappy.Sharp/issues/8)

awr commented 7 years ago

https://github.com/DavidRouyer/Snappy is another option

awr commented 7 years ago

Unfortunately Snappy.Standard doesn't support net462

awr commented 7 years ago

Should be done for #16

awr commented 7 years ago

Kafka now has support for Lz4, which seems like a compelling option.

One possible option here is https://github.com/MiloszKrajewski/lz4net, although we'd need a version based on .net standard 1.3 or something similar

awr commented 7 years ago

Snappy support is now working.