search

SOHU-Co / kafka-node

Node.js client for Apache Kafka 0.8 and later.
MIT License
2.66k stars 627 forks source link

Question: Kafka-Node Consumers in Docker/Openshift #1043

Open techpanga opened 6 years ago

techpanga commented 6 years ago

Questions?

Hi All,

New to kafka-node, trying to have autoscaled consumers in docker containers under same consumer group. I see messages being consumed by only one consumer in this group. All other consumers are waiting. This topic has 9 partitions.

I am using 3 brokers on different machines. kafka colocated with zk. If i test this consumers on my local machine, all consumers are getting messages from all partitions as expected.

Am i missing anything?

Bug Report

Environment

For specific cases also provide

Include Sample Code to reproduce behavior

// include code here

Include output with Debug turned on

Thanks for your contribution!

arpitjain099 commented 6 years ago

Are you using the same consumerGroup ID for all the brokers? Otherwise, it should work fine. Did you also check if the network is rightly configured?

hyperlink commented 6 years ago

Still having issues @techpanga ?