search

awslabs / flowgger

A fast data collector in Rust
BSD 2-Clause "Simplified" License
834 stars 55 forks source link

Kafka compression #3

Closed pdepaepe closed 9 years ago

pdepaepe commented 9 years ago

Please consider kafka compression option. About Snappy vs Gzip, this quite old article might be useful

http://nehanarkhede.com/2013/03/28/compression-in-kafka-gzip-or-snappy/

Thanks

jedisct1 commented 9 years ago

Kafka's protocol is horrible and ruined my weekend, but it's done.

kafka_compression = "none"
kafka_compression = "gzip"
kafka_compression = "snappy"