airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
14.75k stars 3.79k forks source link

[source-auth0] Add Checkpoint Pagination #39493

Open miicchelle opened 3 weeks ago

miicchelle commented 3 weeks ago

Connector Name

source-auth0

Connector Version

0.5.4

What step the error happened?

During the sync

Relevant information

sync for members, organizations, and users failed with status code 400 and error message Requesting page 20 exceeds the allowed maximum of 1000 records. To fetch results beyond 1000, use the checkpoint pagination method

Relevant log output

No response

Contribute

marcosmarxm commented 2 weeks ago

@miicchelle, you can contact me on Slack if you need help with contributing.