search

singer-io / tap-typeform

Singer.io tap for extracting TypeForm data
GNU Affero General Public License v3.0
11 stars 20 forks source link

Stitch/Typeform connexion turn into full-synchronization #54

Closed yinafoodles closed 2 years ago

yinafoodles commented 2 years ago

Hello,

We have several connexions with Typeform via Stitch which get their updates every hour. Since 29th in the evening ( between 8.30 PM and 9.30 PM UTC) , the connector of Stitch-Typeform made a full synchronization of the whole database instead of the incremental method. All of my Typeform connexions are in the same situation, we are forced to stopped them because il cost us too much credits. I made a new typeform yesterday to do a test with a hourly update frequency, no surprise, all my 2 answers that I made yesterday got synchronized every hour.

I saw that my machine began to create that bug at nearly the same time that this PR https://github.com/singer-io/tap-typeform/pull/48 has been merged, could it be the origin? @luandy64 @loeakaodas

Is there anyone else who met the same problem?

Here's the screenshot of the test typeform that I made yesterday and it got sync even today every hour:

Capture d’écran 2021-11-03 à 10 29 41 Capture d’écran 2021-11-03 à 10 30 03

Here's the screen of my previous Typeform which turned into full sync since 29th oct:

Capture d’écran 2021-11-03 à 10 17 05 Capture d’écran 2021-11-02 à 15 43 30

Best regards

pcortajarena commented 2 years ago

Hello,

It happens in my Stitch connections too. Since the previous fix when pagination was not working correctly and the bookmarks either, my connection changed to a full resync whenever the integration runs (in my case every day).

Thanks

hanyufoodles commented 2 years ago

Please consider rollback the version. 🙏 @loeakaodas @luandy64 We do experience this regression that does a full sync everytime and eats up much more credits than necessary everyday. And we don't have the choice but use the current version of the plugin deployed. So please if you don't have time to look at the issue rollback and take your time.

Thanks

michael-urrutia commented 2 years ago

+1 to this causing unnecessary credits for our hourly integration in Stitch