databricks / iceberg-kafka-connect

Apache License 2.0
213 stars 47 forks source link

Coordinator unexpectedly terminated #286

Open annurahar opened 1 month ago

annurahar commented 1 month ago

Created a iceberg sink connector with hourly partition and commit interval as 1 hour. At the time of commit, connector fails with below exception. This connector is working fine when commit interval is set to 15 mins.

Could someone please provide some insights ?

{ "name": "iceberg_lander", "connector": { "state": "RUNNING", "worker_id": "10.7.213.7:8083" }, "tasks": [ { "id": 0, "state": "FAILED", "worker_id": "10.7.211.42:8083", "trace": "org.apache.kafka.connect.errors.ConnectException: Exiting WorkerSinkTask due to unrecoverable exception.\n\tat org.apache.kafka.connect.runtime.WorkerSinkTask.deliverMessages(WorkerSinkTask.java:615)\n\tat org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:333)\n\tat org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:234)\n\tat org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:203)\n\tat org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:189)\n\tat org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:244)\n\tat java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)\n\tat java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\nCaused by: io.tabular.iceberg.connect.channel.NotRunningException: Coordinator unexpectedly terminated\n\tat io.tabular.iceberg.connect.IcebergSinkTask.processControlEvents(IcebergSinkTask.java:168)\n\tat io.tabular.iceberg.connect.IcebergSinkTask.put(IcebergSinkTask.java:158)\n\tat org.apache.kafka.connect.runtime.WorkerSinkTask.deliverMessages(WorkerSinkTask.java:585)\n\t... 10 more\n" } ], "type": "sink" }