There a some issues in the docker compose file in the release ( Scrapy Cluster 1.2.1 ), which is linked in the documentation, I spend about 2 hours trying to find why my kafka cluster won't start or even pass the test.
Here is one of the errors, I've grabbed it from the log
[2020-10-23 14:29:08,832] WARN [Controller id=1, targetBrokerId=1] Error connecting to node broker:29092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) java.net.UnknownHostException: broker: Temporary failure in name resolution at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:929) at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1324) at java.net.InetAddress.getAllByName0(InetAddress.java:1277) at java.net.InetAddress.getAllByName(InetAddress.java:1193) at java.net.InetAddress.getAllByName(InetAddress.java:1127) at org.apache.kafka.clients.ClientUtils.resolve(ClientUtils.java:110) at org.apache.kafka.clients.ClusterConnectionStates$NodeConnectionState.currentAddress(ClusterConnectionStates.java:403) at org.apache.kafka.clients.ClusterConnectionStates$NodeConnectionState.access$200(ClusterConnectionStates.java:363) at org.apache.kafka.clients.ClusterConnectionStates.currentAddress(ClusterConnectionStates.java:151) at org.apache.kafka.clients.NetworkClient.initiateConnect(NetworkClient.java:962) at org.apache.kafka.clients.NetworkClient.ready(NetworkClient.java:294) at org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:65) at kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:297) at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:251) at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96)
I ended up cloning the repository and it worked like a charm.
There a some issues in the docker compose file in the release ( Scrapy Cluster 1.2.1 ), which is linked in the documentation, I spend about 2 hours trying to find why my kafka cluster won't start or even pass the test.
Here is one of the errors, I've grabbed it from the log
[2020-10-23 14:29:08,832] WARN [Controller id=1, targetBrokerId=1] Error connecting to node broker:29092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) java.net.UnknownHostException: broker: Temporary failure in name resolution at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:929) at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1324) at java.net.InetAddress.getAllByName0(InetAddress.java:1277) at java.net.InetAddress.getAllByName(InetAddress.java:1193) at java.net.InetAddress.getAllByName(InetAddress.java:1127) at org.apache.kafka.clients.ClientUtils.resolve(ClientUtils.java:110) at org.apache.kafka.clients.ClusterConnectionStates$NodeConnectionState.currentAddress(ClusterConnectionStates.java:403) at org.apache.kafka.clients.ClusterConnectionStates$NodeConnectionState.access$200(ClusterConnectionStates.java:363) at org.apache.kafka.clients.ClusterConnectionStates.currentAddress(ClusterConnectionStates.java:151) at org.apache.kafka.clients.NetworkClient.initiateConnect(NetworkClient.java:962) at org.apache.kafka.clients.NetworkClient.ready(NetworkClient.java:294) at org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:65) at kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:297) at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:251) at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96)
I ended up cloning the repository and it worked like a charm.