BuzzCutNorman / tap-mssql

Singer Tap for MS SQL built with Meltano Singer SDK.
MIT License
2 stars 9 forks source link

Not supporting log-based incremental update #50

Open smartr-linn opened 1 year ago

smartr-linn commented 1 year ago

Hello, As far as I can see, there is no support for log-based incremental update. Is this something you are planning on supporting in the future? :-)

BuzzCutNorman commented 1 year ago

@smartr-linn,

Thanks for taking the time to look at buzzcutnorman tap-mssql and send in your questions. You are correct currently buzzcutnorman tap-msql does not support log-based replication. Will I write in support for it in the future? Honestly, I don't know. Right now, I am focusing on the sync methods I need for my use case which are full and incremental. Then making sure SDK batch works well for both of those sync methods. I am thinking it will take me the rest of 2023 to accomplish those goals. Once those goals are accomplished, I will start looking into log-based sync as a possible addition.

If you need log-based sync for your use case the default tap-mssql from wintersrd I believe supports log-based sync, and it is a more stable tap for production use.

https://github.com/wintersrd/pipelinewise-tap-mssql#log-based

I hope this answers your questions.