singer-io / tap-chargebee

Singer.io tap for extracting data from the Chargebee API
https://www.singer.io/
GNU Affero General Public License v3.0
7 stars 32 forks source link

Missing Addons imported to redshift #70

Open harz87 opened 3 years ago

harz87 commented 3 years ago

I have the Chargebee Integration running through Stitch. I just noticed that the addons imported to redshift does not include the full list which is available in Chargebee. I do have 10 addons in warehouse and 30 addons in Chargebee. What is the potential root cause for this issue.

theresemoreau commented 3 years ago

Hello @harz87 , I’m currently having the same issue loading subscriptions into BQ. I tried several times to do a full reload, however, each time I get a different number of rows loaded into BQ. First time I got 165.777 rows, an hour later I got 82.981, but the real number should be closer to 1 million. Logs indicate no errors. I can't find any reason the difference.

Have you come across the same issue?

EDIT: I have now also tried doing a full reload of our addons table, which contains 93 rows. Only 71 are loaded. Again, no error messages in the log file and I can't see any pattern as to missing records.

harz87 commented 3 years ago

Hey @theresemoreau for subscriptions I do not face this issue. They get updated or added as new subscriptions appear. For the addons issue, I haven't found a solution or pattern either yet.