[Question] persistent volumes and autoscaling

mesos / kafka

Apache Kafka on Apache Mesos

Apache License 2.0

414 stars 140 forks source link

[Question] persistent volumes and autoscaling #231

Open liorze opened 8 years ago

liorze commented 8 years ago

Hi,

I have a couple of questions:

Can the scheduler automatically increase or decrease the number of brokers? Ref: https://mesosphere.com/blog/2015/07/16/making-apache-kafka-elastic-with-apache-mesos/
Do you support mesos persistent volumes?

oreh commented 7 years ago

I also want to know if mesos persistent volumes are really supported. There is an '--volume' option in adding brokers. But after I setup persistent volume and passing its id to '--volume', the broker can be added but cannot be started.

steveniemitz commented 7 years ago

short answer: --volume is pretty much useless. long answer: I've been experimenting with much better volume support. I think this would be a killer feature and a huge win, however I don't have a ton of time to test it.

The code is in a branch here: https://github.com/tc-dc/kafka-mesos/tree/dynamic-volume-support if anyone wants to test it out. Satya Karthik has been playing around with it as well. (see the slack channel for more info).