search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
14.72k stars 3.78k forks source link

Source Zendesk Support: The source is unresponsive #28828

Open Wolff-Lucas opened 11 months ago

Wolff-Lucas commented 11 months ago

Connector Name

zendesk_support

Connector Version

0.10.4

What step the error happened?

During the sync

Revelant information

After upgrading Airbyte from version 40.30 to 50.11, my incremental sync is not working. The synchronisation process takes a long time, but at the end, the error message "The source is unresponsive" occurs.

Even when attempting to start a sync from scratch, the issue still persists.

I'm not on DBT cloud.

Relevant log output

Above the logs in red :
The source is unresponsive
But classic logs seems to be ok.

Contribute

Wolff-Lucas commented 11 months ago

It's look like it's due to satifaction_rating table. The sync on this table take a long time to sync even in incremental mode. When I unselect this collect it's working.

gustavohwulee commented 9 months ago

Same issue when sending the data to s3 / json format: Source Version: 1.3.0 Airbyte Version: 0.50.15

Heartbeat has stopped. Heartbeat freshness threshold: 10800 secs Actual heartbeat age: 10814 secs
gustavohwulee commented 9 months ago

@Wolff-Lucas , I've separated the satisfaction ratings table in another job and it solved the issue. A load with only 169 and another with 1160 records took 3h to run.

Edit: even in a separate connection it keeps randomly failing with the same error

image