Kafka

[HarshadRanganathan]

Kafka:

https://strimzi.io/blog/2021/12/17/kafka-segment-retention/ https://www.confluent.io/blog/5-common-pitfalls-when-using-apache-kafka/

Streams:

https://medium.com/lydtech-consulting/kafka-streams-introduction-d7e5421feb1b

https://blog.rockthejvm.com/kafka-streams/

Optimization:

https://developers.redhat.com/articles/2022/05/03/fine-tune-kafka-performance-kafka-optimization-theorem#optimization_goals_for_kafka

https://strimzi.io/blog/2021/06/08/broker-tuning/

https://strimzi.io/blog/2021/01/07/consumer-tuning/

https://strimzi.io/blog/2020/10/15/producer-tuning/

https://medium.com/paypal-tech/kafka-consumer-benchmarking-c726fbe4000

https://medium.com/bigpanda-engineering/sleeping-good-at-night-kafka-configurations-tweaks-6dd4d3aaf4e5

https://www.conduktor.io/kafka/kafka-advanced-concepts

Operations:

https://strimzi.io/blog/2020/06/15/cruise-control/

Logstash:

https://discuss.elastic.co/t/multiple-logstash-reading-from-a-single-kafka-topic/27727

[HarshadRanganathan]

https://medium.com/event-driven-utopia/building-cqrs-views-with-debezium-kafka-materialize-and-apache-pinot-part-1-4f697735b2e4

[HarshadRanganathan]

https://medium.com/opendoor-labs/how-we-improved-reliability-of-kafka-consumers-441ccec1416d

[HarshadRanganathan]

https://www.morling.dev/blog/kafka-where-art-thou/

[HarshadRanganathan]

https://blog.cloudflare.com/intelligent-automatic-restarts-for-unhealthy-kafka-consumers/

[HarshadRanganathan]

Retention cleanup policy:

https://dalelane.co.uk/blog/?p=3993

Log compaction cleanup:

https://www.conduktor.io/kafka/kafka-topic-configuration-log-compaction/ https://zendesk.engineering/an-investigation-into-kafka-log-compaction-5e520f4291f0?gi=6d3a1b885470 https://docs.aiven.io/docs/products/kafka/howto/configure-log-cleaner

[HarshadRanganathan]

Consumer group re-balance:

https://dev.to/pierregmn/kafka-rebalancing-impact-on-kafka-streams-consumers-performances-12dn

[HarshadRanganathan]

[HarshadRanganathan]

[HarshadRanganathan]

[HarshadRanganathan]

[HarshadRanganathan]

[HarshadRanganathan]

[HarshadRanganathan]

[HarshadRanganathan]

https://developers.redhat.com/articles/2023/07/05/how-use-kafka-cruise-control-cluster-optimization?sc_cid=7013a000003ShAUAA0#