This made a change in the source task's quierier to hold the offset when a single poll can't fetch the available records so that the poll is retriggered immediately to load the remaining records. There is a unit test and I also tested on some samples.
I am not sure if there is an issue with this approach. Comments welcome.
This made a change in the source task's quierier to hold the offset when a single poll can't fetch the available records so that the poll is retriggered immediately to load the remaining records. There is a unit test and I also tested on some samples. I am not sure if there is an issue with this approach. Comments welcome.