jhc-systems / debezium-connector-ibmi

Debezium Connector for IBM i (AS/400)
16 stars 13 forks source link

re-snapshotting may miss entries as it refetches the current offset #57

Closed msillence closed 1 year ago

msillence commented 1 year ago

The initial snapshot happens by: 1/ fetching the current journal offset 2/ snapshot all tables 3/ start processing journal entries from the offset fetched

When using the signalling features such as the table or kafka topic the journal processing is stopped and snapshotting happens in exactly the same way as above with processing resuming from the offset found just before this snapshot started - ignoring the current journal processing offset

Processing should simply resume at the offset the journal processing had got to

msillence commented 1 year ago

https://github.com/jhc-systems/debezium-connector-ibmi/pull/58