search

helpshift / ekaf

A minimal, high-performance Kafka client in Erlang.
https://engineering.helpshift.com
Other
165 stars 50 forks source link

Why does Kafka build so many connections? #61

Open allenhan opened 5 years ago

allenhan commented 5 years ago

here is my config，Is there any configuration problem for me? image

image

bosky101 commented 5 years ago

Your topic may be having a large number of partitions?

allenhan commented 5 years ago

Your topic may be having a large number of partitions? …

Only five topics, Kafka single-node deployment, are used here. Look at the monitoring for a moment, no access and then the connection has been established all the time.

mskec commented 4 years ago

I have the same issue with a large number of connections. I assume they are causing delay in sending new messages to kafka.

It started happening after upgrading kafka from version v2.0.0 to v2.2.1. It used to be ~16 connections, now it's above 4920.

@allenhan have you found a solution to this?

XinXuanBo commented 2 years ago

@mskec I have the same issue. have you found a solution to this?

mskec commented 2 years ago

@XinXuanBo I haven't found the solution with this library. I guess it's not maintained anymore and you might want to check out another one (eg. https://github.com/kafka4beam/brod)