wurstmeister / kafka-docker

Dockerfile for Apache Kafka
http://wurstmeister.github.io/kafka-docker/
Apache License 2.0
6.94k stars 2.73k forks source link

Developing a version for raspberry pi arm7 #331

Open flefevre opened 6 years ago

flefevre commented 6 years ago

Will it be possible to have the same work done for raspberry pi? raspberry pi communauty could be very interested in those development thanks

sscaling commented 6 years ago

Hi @flefevre - do you have any specific requirements?

flefevre commented 6 years ago

Bonjour / Hello

I am actually using jhipster framework which is using kafka and zookeeper docker containers developed by you.

I was wondering to deploy those container on a raspberry pi 3 with a docker compatible os such as 'pirate hypriot'.

Maybe I can help, at least by testing a jhipster kafka application based on a prototype made by you.

I would appreciate to follow your advice.

François, from France

https://www.jhipster.tech/ https://blog.hypriot.com/

Le 25 mai 2018 20:48, "sscaling" notifications@github.com a écrit :

Hi @flefevre https://github.com/flefevre - do you have any specific requirements?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/wurstmeister/kafka-docker/issues/331#issuecomment-392148051, or mute the thread https://github.com/notifications/unsubscribe-auth/AFWYlJc1u74FX3RRffWIITA-xnlySmuuks5t2FH-gaJpZM4UD8mK .

sscaling commented 6 years ago

Please feel free to submit a PR if you understand what needs to happen. I don't think we'll have any time in the immediate future to look into this.

I think if we did any work to support docker, it would be by the officially supported raspbian OS (https://get.docker.com/)

OneCricketeer commented 6 years ago

it would be by the officially supported raspbian OS

The OS doesn't factor into the CPU architecture, though.

If you rebuild the images from an armhf JRE image (or cross-compile), then it should run fine on a Pi (other than questionable memory requirements)

alexellis commented 5 years ago

Hi folks, I am also interested in this.

As long as no arbitrary binaries, C++ extensions, or bespoke PPAs are used in the Dockerfile, then adding a Dockerfile.armhf may be enough to get the Kafka broker working. Zookeeper might be similar.

I know that @vielmetti has a good knowledge about what software is working on ARM64 and also has an ear to the ground on armhf.

Alex

alexellis commented 5 years ago

This looks problematic:

https://github.com/wurstmeister/kafka-docker/blob/master/Dockerfile#L35

Can the wurstmeister distribution of Apache Kafka also run on a regular Debian JRE?

sscaling commented 5 years ago

wurstmeister distribution of Apache Kafka

There is no such thing. We just re-package the Apache distribution in a Docker image.

So yes, Apache Kafka can run on Debian JRE, However, we use alpine to reduce total size of image. Currently it looks like the slim Debian build is still ~2x larger

openjdk    8u212-jre-slim                 1d98c8a8ff74        3 weeks ago         168MB
openjdk    8u212-jre-alpine               f7a292bbb70c        8 weeks ago         84.9MB

Of course, adding the glibc library adds some additional space requirements - however, this is technically only needed for SNAPPY compression as far as i'm aware.

bqstony commented 5 years ago

@alexellis: do you have any progress on this? i have tryed the forked images from https://github.com/SUMGlobal/rpi-kafka, but run in some unknown errors.

bqstony commented 5 years ago

If someone has the same need to run on a raspi, i have modified this repo in my fork and you can build the images on a raspberry. see: https://github.com/bqstony/kafka-docker and here https://github.com/bqstony/zookeeper-docker

alexellis commented 5 years ago

Not on my side, but with the 4GB RPi, I think Kafka is becoming viable.

Perhaps we can see if the maintainer would accept a patch?

bqstony commented 5 years ago

There is a open PR #257 that would this Patch idea made some easyer to implement.

humb1t commented 5 years ago

@flefevre sumglobal/rpi-kafka and sumglobal/rpi-zookeeper works on rpi

NGLSL commented 4 years ago

@flefevre sumglobal/rpi-kafka and sumglobal/rpi-zookeeper works on rpi

It can run