Open fdelbrayelle opened 4 years ago
The goal is to have high throughput producers through messages compression.
This can be achieved through:
compression.type
linger.ms
0
5
batch.size
16384
32768
Warning: gzip give a better compression rate but is slow so snappy should be preferred as it's very efficient for text messages such as logs, tweets or JSON.
gzip
snappy
There is no impact on broker or consumer configuration.
The goal is to have high throughput producers through messages compression.
This can be achieved through:
compression.type(see: https://docs.confluent.io/current/installation/configuration/producer-configs.html#compression.type)linger.mswhich is by default set to0but can be increased to5ms (see: https://docs.confluent.io/current/installation/configuration/producer-configs.html#linger.ms)batch.sizewhich is by default set to16384can be set to32768bytes but no more to avoid to waste memory (see: https://docs.confluent.io/current/installation/configuration/producer-configs.html#batch.size)Warning:
gzipgive a better compression rate but is slow sosnappyshould be preferred as it's very efficient for text messages such as logs, tweets or JSON.There is no impact on broker or consumer configuration.