OneCricketeer / apache-kafka-connect-docker

[KAFKA-9774] Un-official Docker Image for Apache Kafka Connect
https://issues.apache.org/jira/browse/KAFKA-9774
Apache License 2.0
34 stars 15 forks source link

Scaling out the cluster #11

Closed OneCricketeer closed 1 year ago

OneCricketeer commented 2 years ago

Document using Docker Compose scaling of the connect-jib service.

To start, this is necessary change

ports:
      - '8083'

Then need to use docker ps to find a particular port since there's no reverse proxies here

But sending a request to the wrong container throws an error 😢

I assumed the workers would default to advertise themselves using the container hostnames and default ports, but apparently not

OneCricketeer commented 2 years ago

https://stackoverflow.com/questions/54325552/kafka-connect-cannot-complete-request-because-of-a-conflicting-operation