faros-ai / airbyte-connectors

Airbyte connectors (sources & destinations) + Airbyte CDK for JavaScript/TypeScript
Apache License 2.0
108 stars 64 forks source link

Azure ad connector is failing after pulling 100 users from ad we have around 3000 users #365

Closed tovbinm closed 2 years ago

tovbinm commented 2 years ago

Probably a bug in pagination?

prakashcc commented 2 years ago

Hi Team,

I was trying the azure ad connector and I select MongoDB as the destination. A few things I noticed are

when I selected the 24hour replication frequency it started throwing the error after pulling 100 users and then I changed the frequency from 24 hours to 5 min, then it started pulling 100 users in each 5 min. I am not sure is it a bug or by design, it is like that but as a user, I expect the first sync should be completed without the frequency and then replication should work as expected.

tovbinm commented 2 years ago

Fixed in https://github.com/faros-ai/airbyte-connectors/pull/370