search

yahoo / CMAK

CMAK is a tool for managing Apache Kafka clusters
Apache License 2.0
11.84k stars 2.51k forks source link

Add support for Kafka 0.10+ #268

Open abtpst opened 8 years ago

abtpst commented 8 years ago

Please add support for Kafka 0.10+

falmp commented 8 years ago

I'm using it with Kafka 0.10.0.0 with no major problems.

KaimingWan commented 8 years ago

The wiki says as follows:

Create a topic with optional topic configs (0.8.1.1 has different configs than 0.8.2+) Delete topic (only supported on 0.8.2+ and remember set delete.topic.enable=true in broker config) Topic list now indicates topics marked for deletion (only supported on 0.8.2+)

Do these features work well with kafka 0.10?

csghuser commented 8 years ago

Has anyone enabled SSL inter broker communication / SASL_SSL auth with kafka in 0.10, and then tried to use kafka manager to manage the cluster?

It doesn't seem to work for me. Is this something which needs adding?

Edit - Just in case anyone else has this issue, the work around is to configure a plaintext listener for kafka-manager to connect to 

listeners=SASL_SSL://:9092,SSL://:9093,PLAINTEXT://:9094

If you then only allow your kafka manager server to connect to port 9094 via iptables or some other means, everything else is forced to use SSL while kafka manager can still connect.

falmp commented 8 years ago

@KaimingWan I can state that topic deletion and marked for deletion works for Kafka 0.10.0.0.

KaimingWan commented 8 years ago

@falmp I have some problem in compiling kafka-manager. Would you mind sending me the code after compiling with sbt? My email is 344277934@qq.com or wan0573@gmail.com. Thanks!

falmp commented 8 years ago

@KaimingWan What kind of problem? Anyway, sent you the link.

KaimingWan commented 8 years ago

@falmp I have solved the problem. Thanks anyway~

freemanlutsk commented 8 years ago

Hi all! Any ETA Kafka 0.10+ ? :)

csghuser commented 8 years ago

@freemanlutsk There is currently a pull request open to add support for 0.10 here https://github.com/yahoo/kafka-manager/pull/282

benMain commented 7 years ago

Appreciate the 0.10 support. I see a consumer.properties file in conf/ where the security.protocol is defaulted to PlainText. Due to HIPAA constraints we are only allowed to only open SSL listeners on our brokers, but it doesn't appear that trying to assign the security.protocol=SSL and attempting to assign the Keystore (ssl.keystore.location) and TrustStore (ssl.truststore.location) can work. Actually, when I trace the properties back to KafkaStateActor.scala it appears to only be concerned with the ConsumerConfig and not the CommonConfig.SSLConfig. Granted I might be missing something, but this is the only passable UI for Kafka Management, and I don't want to give it up for security reasons.

patelh commented 7 years ago

@benMain this is work in progress, we are in process off adding SSL to our clusters and then we'll update KM

mabeyratne commented 7 years ago

what version of SSL supports Kafka-Manager? How would you provide ssl.truststore information to KM? We can only use SSL on our Kafka cluster for security reasons.

thammuio commented 6 years ago

Great Tool. any timeline on supporting SASL_SSL?

Labibme commented 6 years ago

SSl part is really ambigous, i just succeed to get full information on full plaintext only