search

agoda-com / kafka-jdbc-connector

Simple way to copy data from relational databases into kafka.
https://github.com/agoda-com/kafka-jdbc-connector/wiki
Apache License 2.0
20 stars 8 forks source link

Support for PostgreSQL #4

Open arpanchaudhury opened 7 years ago

arpanchaudhury commented 7 years ago

Add support to copy change data from PostgreSQL

atiqsayyed commented 7 years ago

I can pick this issue, do we wanna discuss how should we approach this?

arpanchaudhury commented 7 years ago

Thanks @atiqsayyed. There are 2 things that need to be done here.

  1. Updating kafka-jdbc-connector a. Add one more entry for PostgreSQL in DatabaseProduct.scala. b. Add prepareStatement to poll data from PostgreSQL in IdBasedDataService.scala, TimeBasedDataService.scala and TimeIdBasedDataService.scala.

  2. Updating sample a. add docker functional test KafkaConnectPostgresqlFunctionalTest.scala

atiqsayyed commented 7 years ago

I've started working on it