search

confluentinc / kafka-connect-jdbc

Kafka Connect connector for JDBC-compatible databases
Other
19 stars 956 forks source link

JDBC Source Connector connection.url error #1198

Open dipdeb opened 2 years ago

dipdeb commented 2 years ago

Hi I have installed the confluent local version - 7.1.1. After installing the kafka-connect-jdbc getting this error An unexpected error occurred: org.apache.kafka.common.config.ConfigException: Missing required configuration "connection.url" which has no default value. on clicking the JdbcSourceConnector tile on the control center.

How to solve this problem?

OneCricketeer commented 2 years ago

According to the error, you didn't supply the listed value, which is required.

I'd recommend using the Connect rest api directly rather than control center to better diagnose the problem

dipdeb commented 2 years ago

@OneCricketeer thanks for the idea. It's working now. The problem is in the latest version of kafka-connect-jdbc (10.5.0). I had installed kafka-connect-jdbc couple months back in another machine and it is working, so I checked the version of jdbc connector in the old machine, using curl localhost:8083/connector-plugins | jq and tried installing the same version in the new machine instead of using "latest" in confluent-hub install --no-prompt confluentinc/kafka-connect-jdbc:10.3.3

OneCricketeer commented 2 years ago

Glad to hear it. Feel free to close the issue

miramar-labs commented 2 years ago

I see the same issue and the problem is that when you select it in the Control Center 'Add Connector' web gui, the validation happens on page load, exception occurs and the usual config screen is unable to display .... image

OneCricketeer commented 2 years ago

exception occurs and the usual config screen is unable to display

But you still have the ability to add the url under Additional Properties.

This issue itself is not with the JDBC connector. It should be brought up elsewhere for Control Center.

miramar-labs commented 2 years ago

But you still have the ability to add the url under Additional Properties.

but even if you do that, you've then lost all the other properties that need to be set ... the page doesn't 'reload' ...

seems to me these properties need to have default values specified in order for the UI to work .... (it's not just connection.url either) .. or maybe the UI should be validating on submit instead of on load .. happy to submit an issue in the UI repo if you can tell me where that is.

bjosloff commented 2 years ago

Any update on this issue. I'm see the same problem on CP 7.2.1 control center.
Version 10.4.x and above are throwing this error. An unexpected error occurred: org.apache.kafka.common.config.ConfigException: Missing required configuration "connection.url" which has no default value.

miramar-labs commented 2 years ago

while you wait for a resolution, a workaround is to toss the web GUI altogether and use scripts/REST calls to manage your connectors - see here

mikementzmaersk commented 2 years ago

Same issue here, with a variety of different kafka connect UI's (akhq, kafka-ui etc...) - as well as failures provisioning via api port 8083 directly. 10.3.3 is the only version this works on, all versions since have this issue.