databricks / iceberg-kafka-connect

Apache License 2.0
219 stars 49 forks source link

Facing an issue - No partitions assigned, cannot determine leader #276

Open sagarm-traveloka opened 4 months ago

sagarm-traveloka commented 4 months ago

I am doing POC with AWS MSK Cluster and Sink Connector to consume the topics log and create iceberg catalog.

Whenever I used terraform to deploy the connector, I am facing an issue -

org.apache.kafka.connect.errors.ConnectException: No partitions assigned, cannot determine leader
at io.tabular.iceberg.connect.channel.CoordinatorThreadFactoryImpl.lambda$isLeader$1(CoordinatorThreadFactoryImpl.java:66)

But when I try to create the connector using AWS Console, I am able to run the connector. I do not understand what will be cause where this isLeader() logic behave differently. Anybody here encounter such error and any possible workaround to fix it.