search

z3z1ma / tap-mongodb

Tap for mongodb emphasizing simplicity and leveraging Meltano SDK
MIT License
10 stars 4 forks source link

Date-like replication key does not work. #8

Open edsoncezar16 opened 1 year ago

edsoncezar16 commented 1 year ago

I had a use case for his tap where I needed to use an "updatedAt" field for the replication key and it simply did not work. Whenever I ran the task with a state, the tap reported no records, even though there were records in the database whose "updatedAt" value was greater than the one in the bookmark.

I have a working fork where I simply added a new setting for the tap so that the user can tell if the tap is supposed to use a date-like replication key.

I will open a PR and I am available to discuss this issue further.

techtangents commented 1 week ago

I'm also experiencing this issue.