wbarnha / kafka-python-ng

Fork for Python client for Apache Kafka
https://wbarnha.github.io/kafka-python-ng/
Apache License 2.0
42 stars 4 forks source link

Kafka memory leak #181

Open ArtyomIvlev opened 1 month ago

ArtyomIvlev commented 1 month ago

Hello, i want to configurate my consumer with queued.max.messages.kbytes. How i can configure that? But KafkaConsumer have't this config? Description: I found out that my message consumer starts to consume too much memory when the message lags. Locally I was able to set that 50000 messages completely consumes the message consumer's memory (128Mb) and it just shuts down. How can I fix this situation?