confluentinc / kafka-connect-jdbc

Kafka Connect connector for JDBC-compatible databases
Other
20 stars 956 forks source link

newbie cant get a simple connect to work - please help! #703

Open ptnewman13 opened 5 years ago

ptnewman13 commented 5 years ago

I am trying to create my first sink and following these directions https://docs.confluent.io/3.1.1/connect/connect-jdbc/docs/sink_connector.html

connect-standalone /home/kafka/Downloads/confluent-5.3.0/etc/schema-registry/connect-avro-standalone.properties /home/kafka/Downloads/confluent-5.3.0/etc/kafka-connect-jdbc/sink-quickstart-sqlite.properties

when i start the connect-standalone eventually i get this error Caused by: java.sql.SQLException: No suitable driver found for jdbc:sqlite:test.db

i do see this when the command is running [2019-09-09 11:00:40,719] INFO Loading plugin from: /home/kafka/Downloads/confluent-5.3.0/share/java/kafka-connect-jdbc/sqlite-jdbc-3.25.2.jar

so its finding the jar file. i have not changed anything from the sample files, contents of the sink-quickstart-sqlite.properties is name=test-sink connector.class=io.confluent.connect.jdbc.JdbcSinkConnector tasks.max=1 topics=orders connection.url=jdbc:sqlite:test.db auto.create=true

Note that i am running the confluent quick start setup by running confluent local start i start zookeeper, kafka, schema-registry, and kafka-rest i can run producer and consumer tasks and can that part is working

any help would be much appreciated!!

ptnewman13 commented 5 years ago

Also, i copied the sqlite jar file to my laptop, and used that jar file to connect to a sqlite database, so i know the jar file is ok. thanks

mariusneo commented 5 years ago

If you have sqlite3 installed on your machine, you simply need to look for the file ${confluent.home.dir}/test.db.

You can connect afterwards to this file via

sqlite3 test.db

/bin/confluent local load test-sink -- -d /home/user/confluent-5.3.1/etc/kafka-connect-jdbc/test-sink-sqlite.properties

(you have to change the name of the connector and of the configuration file according to your environment).

Afterwards you should see the configuration of your previously registered sink through this command

curl -X GET http://localhost:8083/connectors/test-sink | jq