search

lovoo / goka

Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.
BSD 3-Clause "New" or "Revised" License
2.35k stars 175 forks source link

test: upgrade version of zookeeper and kafka to 7.6.0 #447

Closed kitimark closed 4 months ago

kitimark commented 7 months ago

Hi, contributors. This PR provide an upgrade version of Zookeeper and Kafka to 7.6.0 for support arm architecture

I found the previous docker compose in examples folder can't be run it in my macbook pro m1. I got an error like this when run make start in example folder.

$ make start
start docker compose
[+] Running 10/10
 ✔ Network examples_default                                                                                                                              Created                0.0s
 ✔ Container redis                                                                                                                                       S...                   0.0s
 ✔ Container zoo1                                                                                                                                        St...                  0.0s
 ! zoo1 The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested                          0.0s
 ✔ Container kafka3                                                                                                                                      Started                0.0s
 ✔ Container kafka1                                                                                                                                      Started                0.0s
 ✔ Container kafka2                                                                                                                                      Started                0.0s
 ! kafka3 The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested                        0.0s
 ! kafka2 The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested                        0.0s
 ! kafka1 The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested                        0.0s
done
nc: connectx to localhost port 2181 (tcp) failed: Connection refused
Connection to localhost port 2181 [tcp/eforward] succeeded!
localhost:2181 is up. Continuing.
nc: connectx to localhost port 9092 (tcp) failed: Connection refused
Connection to localhost port 9092 [tcp/XmlIpcRegSvc] succeeded!
localhost:9092 is up. Continuing.
nc: connectx to localhost port 9093 (tcp) failed: Connection refused
Connection to localhost port 9093 [tcp/*] succeeded!
localhost:9093 is up. Continuing.
nc: connectx to localhost port 9094 (tcp) failed: Connection refused
Connection to localhost port 9094 [tcp/*] succeeded!
localhost:9094 is up. Continuing.
Connection to localhost port 6379 [tcp/*] succeeded!
localhost:6379 is up. Continuing.
All dependencies are up. Ready!
[2024-02-16 08:09:17,455] WARN [AdminClient clientId=adminclient-1] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-02-16 08:09:17,497] WARN [AdminClient clientId=adminclient-1] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-02-16 08:09:17,608] WARN [AdminClient clientId=adminclient-1] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-02-16 08:09:17,937] WARN [AdminClient clientId=adminclient-1] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-02-16 08:09:18,443] WARN [AdminClient clientId=adminclient-1] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-02-16 08:09:19,268] WARN [AdminClient clientId=adminclient-1] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-02-16 08:09:20,418] WARN [AdminClient clientId=adminclient-1] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-02-16 08:09:21,437] WARN [AdminClient clientId=adminclient-1] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-02-16 08:09:22,667] WARN [AdminClient clientId=adminclient-1] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2024-02-16 08:09:23,781] WARN [AdminClient clientId=adminclient-1] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
...

If you have any concern, feel free to comments. thanks.

kitimark commented 7 months ago

It seems like flaky test I ran test on my own folk. I retried 1 count. It's success https://github.com/kitimark/goka/pull/2

Would we have to fix something?

frairon commented 4 months ago

Sorry for our inactivity @kitimark! Yeah the tests are flaky sometimes :-/. Thanks a lot for the update!