search

bersler / OpenLogReplicator

Open Source Oracle database CDC
https://www.bersler.com
GNU General Public License v3.0
282 stars 133 forks source link

Feature: Allow sending DMLs to different Kafka topics based on table name #42

Open bersler opened 1 year ago

bersler commented 1 year ago

Is your feature request related to a problem? Please describe. Currently all transactions are sent just to one Kafka topic.

Describe the solution you'd like It would be useful to divide the load into multiple topics and send transactions to certain topic based on table name or other conditions.

Describe alternatives you've considered To divide the load - such spread of transactions to multiple Kafka topics can be made as an another level of transaction processing.

Additional context Dividing transactions might mean that we lose transaction consistency.

bersler commented 1 year ago

This feature is complicated to implement.. If there is a demand from users more focus could be given here.

sonnguyen-dba commented 1 year ago

Hi Adam, I think this feature very useful for resource. (reduce the number of instance OpenLogReplicator ).

Regards, Son

bersler commented 1 year ago

Thanks @sonnguyen-dba , I agree. This might help user a lot.