search

streamnative / pulsar-archived

Apache Pulsar - distributed pub-sub messaging system
https://pulsar.apache.org
Apache License 2.0
72 stars 25 forks source link

ISSUE-12174: [Pulsar IO]Support JDBC-Source for data sync, when Debezium does not meet the demand #3091

Open sijie opened 3 years ago

sijie commented 3 years ago

Original Issue: apache/pulsar#12174

In issue#2442, Pulsar IO already support JDBC-sink and debezium-source.

In some simple scenarios, I expect a more direct way to synchronize data, not rely on third-party debezium. And in some special cases, it is not easy to obtain binlog data. I hope to use JDBC connection through Pulsar to support richer DB sources.

Here are some tools that can be used based on kafka and flink:

I think the synchronization methods based on Event-log (e.g. binlog) and query have their own advantages. Supporting both methods at the same time can cover more usage scenarios.

We are trying to migrate the kafka connect application to pulsar. One of the tasks is to support jdbc-source. Does this work conform to the development trend of the Pulsar community? If the community needs it, we will try to implement this method in the community first.

Is your feature request related to a problem? Please describe.

github-actions[bot] commented 2 years ago

The issue had no activity for 30 days, mark with Stale label.