deric
commented
6 years ago dcos-kafka-service is outdated and deprecated. The successor is DC/OS Kafka (or at least we can call it that way, there are many other kafka versions in the DC/OS Universe).
DC/OS Kafka is build on top of DC/OS commons project that aims to simplify deploying of statefull services by sharing some common functionality. Thus when using DC/OS (Mesos and approximately 30 other services running on top of your OS) you can benefit from:
- load-balanced Kafka broker endpoints
- easy broker adding (almost impossible to remove a broker)
- CLI integration as simple as
dcos kafka topic list - kafka 0.11 and 1.0 are both available
On the other hand, mesos/kafka supports:
- topic rebalancing
- updating topics
- setting setting different configuraition per each broker
- removing brokers
My impression is that currently the DC/OS project offers only limited functionality in terms of service maintenance. Although if you're more interested in newer kafka broker version it might be better choice.
I’m doing a POC to deploy Kafka as an application on Mesos Cluster. I came across these 2 codebases on github. One developed by apache-mesos (github page) & other developed by mesosphere and can run only on DCOS (github page).
Question: Would like to know if there are any differences between DCOS-Kafka & mesos-Kafka in terms of features and extended functionality.
Regarding Mesos-Kafka: I don’t see active participation on github (and some open issues) for mesos-kafka in the past months. Can I assume that the service is robust enough that I can use in production environment? Any Inputs on this would be helpful.
// Not sure if this is the correct place to ask or not.