search

confluentinc / kafka-streams-examples

Demo applications and code examples for Apache Kafka's Streams API.
Apache License 2.0
57 stars 1.15k forks source link

Kafka Streams Listing and Trying describe topics not part of the topology #220

Closed santanu33 closed 5 years ago

santanu33 commented 5 years ago

we have a simple Kafka Stream filtering application which is working perfectly except one thing.

The stream application trying to describe every topic in the cluster. After googling the most relevant thread I have found is https://stackoverflow.com/questions/54599482/kafka-streams-listing-and-trying-describe-topics-not-part-of-the-topology

mjsax commented 5 years ago

What is your question?

ArsenGasparyan commented 4 years ago

I also have the same problem. I have ACLs on some topics and they are not included in Kafka streams topology. But when I am running my Kafka stream app it wants to describe those topics also and I have a bunch of errors in a log file. So I want to know how I can fix it?

mjsax commented 4 years ago

Unfortunately, you cannot do much. It's a know issue and we actually plan to address it in AK 2.5 release (https://issues.apache.org/jira/browse/KAFKA-7317).

For now, you need to set ACL as described in the docs: https://docs.confluent.io/current/streams/developer-guide/security.html#required-acl-setting-for-secure-ak-clusters