search

cloudstax / firecamp

Serverless Platform for the stateful services
https://www.cloudstax.io
Apache License 2.0
208 stars 21 forks source link

Replace Kafka with the newest #84

Open jazzl0ver opened 5 years ago

jazzl0ver commented 5 years ago

Hi,

What do you think of replacing Kafka to the latest (2.12-2.1.0)? Alternative is to put it aside and choose the needed version in the template or from firecamp-service-cli (I personally don't like this approach).

jazzl0ver commented 5 years ago

Meaning, I can do that and send you a PR. Just would like to know your opinion

JuniusLuo commented 5 years ago

Thanks @jazzl0ver ! I agree we should just upgrade Kafka to the latest 2.x.

prasantmathad commented 5 years ago

what is the process to upgrade kafka? via firecamp cli ?

jazzl0ver commented 5 years ago

There're two options:

  1. Wait for @JuniusLuo to merge my PR and release the new Firecamp version. Then you re-create Kafka cluster (no in-place upgrade) from scratch (delete the existing Kafka cluster and launch a new one - both thru firecamp-service-cli tool)
  2. Build your own docker package for Kafka (check BUILD_YOUR_IMAGES.md), manually update the Kafka ECS Task Definition to point it to your docker package, then re-create the cluster from scratch (see above)
prasantmathad commented 5 years ago

We understand that latest kakfa version 2.1 is available which was committed on 1st feb 19. We built kafka with firecamp cli on 6th Mar 2019 but still its running with old version. please help.

nagaraj07 commented 5 years ago

I'm also facing same issue. We created the new kafka cluster today only but still it's taking old kafka version 1.0. I can see two dockerfile 1.0 and 2.1 for kafka catalog. I feel it's picking still default dockerfile 1.0 to build the new image. Can you please help here? How to upgrade to kafka version 2.x ?

jazzl0ver commented 5 years ago

Did you update the firecamp-cli tool? You should also install the latest version of Firecamp

prasantmathad commented 5 years ago

can you share the latest firecamp cli tool?

jazzl0ver commented 5 years ago

just checked - unfortunately, that won't help you. @JuniusLuo has to build docker images and push them to his dockerhub repo. that means the new firecamp release.

nagaraj07 commented 5 years ago

When can we expect new firecamp release with updated Kafka version 2.x ?