Event Hub with debezium MySQL connector Timeout exception

[vinodsugur]

Description

We are planning to stream MySQL data using CDC onto EventHub using KafkaConnect. I have done all the required configuration but the connector gives following error:

{"name":"mysql-connector","connector":{"state":"RUNNING","worker_id":"connect:8083"},"tasks":[{"id":0,"state":"FAILED","worker_id":"connect:8083","trace":"org.apache.kafka.connect.errors.ConnectException: org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:291)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:106)\n\tat org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:232)\n\tat org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:185)\n\tat org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:235)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n\tat java.lang.Thread.run(Thread.java:748)\nCaused by: org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata\n"}],"type":"source"}

We have tried the File source and Sink connector using KafkaConnect and it works fine.

How to reproduce

Refer following documentation for MySQL and KafkaConnect connector configuration. https://debezium.io/documentation/reference/tutorial.html

Has it worked previously?

This is the first time.

Checklist

Please provide the relevant information for the following items:

• [x] SDK (include version info): confluent-6.0.1.tar.gz, debezium-connector-mysql-1.5.0-20210201.040639-115-plugin.tar.gz
• [x] confluent-6.0.1/bin/connect-distributed connect-distributed.properties
• [x] Operating system: Amazon Linux 2

If this is a question on basic functionality, please verify the following:

• [x] Port 9093 is not blocked.
• [x] Pinging FQDN returns cluster DNS resolution
• [x] Namespace is Standard

[vigneshsatha]

I am also facing similar issue. Are you able to resolve this issue?

[divya2424]

Hi Any resolution we have found for this?

[alesacchi]

Hi, having the same issue. Is there any update?