search

lensesio / fast-data-dev

Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, Landoop Tools, 20+ connectors
https://lenses.io
Apache License 2.0
2.01k stars 330 forks source link

The docker image doesn't work with theApple M1 chip #182

Open Chaklader opened 2 years ago

Chaklader commented 2 years ago

When I try to run the docker image in the Apple M1 chip computer, it always shows that port 2181 is blocked. I had to modify the Dockerfile to solve the issue temporarily, but, please, provide an official solution for the problem.

luongnv-se commented 2 years ago

I think Docker have Docker for M1 chip (apple chip). You can find Docker version for Apple Chip as below

senwangJC commented 2 years ago

When I try to run the docker image in the Apple M1 chip computer, it always shows that port 2181 is blocked. I had to modify the Dockerfile to solve the issue temporarily, but, please, provide an official solution for the problem.

Please tell me how did you get away with it, I'm having the same issue.

senwangJC commented 2 years ago

I think Docker have Docker for M1 chip (apple chip). You can find Docker version for Apple Chip as below

I installed the apple silicon version for it, it does no help.

runtime.systemstack_switch() /usr/lib/go/src/runtime/asm_amd64.s:252 fp=0xc42002a768 sp=0xc42002a760

I think the golang there is just not happy.

Chaklader commented 2 years ago

Yes, I also use Docker for the Apple silicon and it's not working.

On Thu, Jan 13, 2022 at 9:32 AM senwangJC @.***> wrote:

I think Docker have Docker for M1 chip (apple chip). You can find Docker version for Apple Chip as below

I installed the apple silicon version for it, it does no help.

runtime.systemstack_switch() /usr/lib/go/src/runtime/asm_amd64.s:252 fp=0xc42002a768 sp=0xc42002a760

I think the gaoling there is just not happy.

— Reply to this email directly, view it on GitHub https://github.com/lensesio/fast-data-dev/issues/182#issuecomment-1011754589, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAKMC6PERCFHKQRRB7LBTO3UVZBWLANCNFSM5JMMG3HA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you were mentioned.Message ID: @.***>

FilipeNavas commented 2 years ago

I was looking for a solution, and after trying a few things was able to come up with an alternative. It is a docker-compose made up of differente services and it also provides a GUI to manage your cluster. It worked on M1.

Check it out here: https://github.com/FilipeNavas/kafka-local

Chaklader commented 2 years ago

I can confirm the docker-compose file is working and can be up within a few minutes in the M1 machine. Currently, I don't work in any Kafka project, so, can't say more but the UI looks clean.

On Fri, Jan 21, 2022 at 9:22 AM Filipe Navas @.***> wrote:

I was looking for a solution, and after trying a few things was able to come up with an alternative. It is a docker-compose made up of differente services and it also provides a GUI to manage your cluster. It worked on M1.

Check it out here: https://github.com/FilipeNavas/kafka-local

— Reply to this email directly, view it on GitHub https://github.com/lensesio/fast-data-dev/issues/182#issuecomment-1018131875, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAKMC6JJIZLAMIZMSTNO24LUXDGPXANCNFSM5JMMG3HA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you were mentioned.Message ID: @.***>

vikrampunchh commented 2 years ago 

    image: landoop/fast-data-dev:latest
    restart: unless-stopped
    container_name: kafka
    ports:
      - '3030:3030'
      - '8081-8083:8081-8083'
      - '9581-9585:9581-9585'
      - '9092:9092'
    environment:
      ADV_HOST: '127.0.0.1'```

getting error on docker-compose  up (M1 chip):

Broker config found at '/var/run/broker/server.properties'. We won't process variables.
kafka  | Connect worker config found at '/var/run/connect/connect-avro-distributed.properties'. We won't process variables.
kafka  | Schema registry config found at '/var/run/schema-registry/schema-registry.properties'. We won't process variables.
kafka  | REST Proxy config found at '/var/run/rest-proxy/kafka-rest.properties'. We won't process variables.
kafka  | Zookeeper config found at '/var/run/zookeeper/zookeeper.properties'. We won't process variables.
kafka  | runtime: failed to create new OS thread (have 2 already; errno=22)
kafka  | fatal error: newosproc
kafka  | 
kafka  | runtime stack:
kafka  | runtime.throw(0x512269, 0x9)
kafka  |    /usr/lib/go/src/runtime/panic.go:566 +0x95
kafka  | runtime.newosproc(0xc420030000, 0xc42003ffc0)
kafka  |    /usr/lib/go/src/runtime/os_linux.go:160 +0x194
kafka  | runtime.newm(0x5203a0, 0x0)
kafka  |    /usr/lib/go/src/runtime/proc.go:1572 +0x132
kafka  | runtime.main.func1()
kafka  |    /usr/lib/go/src/runtime/proc.go:126 +0x36
kafka  | runtime.systemstack(0x593600)
kafka  |    /usr/lib/go/src/runtime/asm_amd64.s:298 +0x79
kafka  | runtime.mstart()
kafka  |    /usr/lib/go/src/runtime/proc.go:1079
kafka  |
okazwini commented 2 years ago

Hello, Did anyone find a solution to this? Thanks

vikrampunchh commented 2 years ago

@okazwini here is the solution.

dougdonohoe commented 1 year ago

Expanding on the previous comment, my https://github.com/lensesio/fast-data-dev/pull/185 PR makes a multi-arch image. Try 

docker pull dougdonohoe/fast-data-dev
Tjerk-Haaye-Henricus commented 1 year ago

Hey There,

i wonder if this PR is merged already

best regards