fluent / fluent-bit

Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows

https://fluentbit.io

Apache License 2.0

5.87k stars 1.59k forks source link

zstd compression to both the Kafka input and Kafka output processors #9367

Open hafkaM opened 2 months ago

hafkaM commented 2 months ago

Is your feature request related to a problem? Please describe.

Describe the solution you'd like

Describe alternatives you've considered

Additional context Would it be possible to add support for zstd compression to both the Kafka input and Kafka output processors? For high-performance tasks, this compression is more efficient and is currently only available in Fluentd. However, Fluentd is slower compared to Fluent Bit.

patrick-stephens commented 2 months ago

Related to #2483 which seems to enable it for output. Also:

5957 #4564 #7715

leonardo-albertovich commented 2 months ago

So, do I understand correctly that even though a PR aimed to address this was merged back in 2020 this is still not working?