search

lsst-uk / lasair-lsst

Apache License 2.0
0 stars 0 forks source link

Mirrormaker parameters #148

Closed gpfrancis closed 2 months ago

gpfrancis commented 2 months ago

Testing has identified a set of mirrormaker parameters that give significantly improved performance than the default. Include these in the deployment.

receive.buffer.bytes=1048576
fetch.min.bytes=524288
fetch.max.wait.ms=1000
heartbeat.interval.ms=10000
max.partition.fetch.bytes=4194304
max.poll.records=1000

Additionally we will need to include security parameters in future.

security.protocol=SASL_PLAINTEXT
sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required username='********' password='********';
sasl.mechanism=SCRAM-SHA-512