airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
14.72k stars 3.78k forks source link

Source Zendesk Support: òrganisation` sync issue missing data #28764

Open swapnasam opened 11 months ago

swapnasam commented 11 months ago

Connector Name

zendesk support

Connector Version

0.10.4

What step the error happened?

During the sync

Revelant information

While importing the organisation table using any of the sync it limits only to 100 id's whereas we are expecting around 1800. Is some rate limit happening here? Also, with the ticket_metrics table, we can get retrieve only the non archived tickets metrics and we are loosing all the historic data.

Relevant log output

No response

Contribute

swapnasam commented 11 months ago

Looks like a pagination issue.

swapnasam commented 11 months ago

class Organizations(CursorPaginationZendeskSupportStream):

Changing to this worked in my local. Unable to raise a PR because of docker build failure

potatozerg commented 10 months ago

I believe they messed it up in 0.10.1