status-im / airbyte-custom-connector

Repository holding all of Airbyte Custom Connector used in Status
1 stars 1 forks source link

[SimpleCast] API limit reached #16

Open apentori opened 3 weeks ago

apentori commented 3 weeks ago

When running the Simplecast connector, we reach the API limit each time:

2024-06-11 07:37:50 source > Backing off _send(...) for 5.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException: Request URL: https://api.simplecast.com/analytics/downloads?episode=9218b70c-132e-400c-8015-84ad2bb3d8e1, Response Code: 429, Response Text: {"status":429,"href":null,"error_message":"You have exceeded your api key request quota for this account","error":"too_many_requests"})
2024-06-11 07:37:50 source > Caught retryable error 'Request URL: https://api.simplecast.com/analytics/downloads?episode=9218b70c-132e-400c-8015-84ad2bb3d8e1, Response Code: 429, Response Text: {"status":429,"href":null,"error_message":"You have exceeded your api key request quota for this account","error":"too_many_requests"}' after 1 tries. Waiting 5 seconds then retrying...
2024-06-11 07:37:55 source > Backing off _send(...) for 10.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException: Request URL: https://api.simplecast.com/analytics/downloads?episode=9218b70c-132e-400c-8015-84ad2bb3d8e1, Response Code: 429, Response Text: {"status":429,"href":null,"error_message":"You have exceeded your api key request quota for this account","error":"too_many_requests"})
2024-06-11 07:37:55 source > Caught retryable error 'Request URL: https://api.simplecast.com/analytics/downloads?episode=9218b70c-132e-400c-8015-84ad2bb3d8e1, Response Code: 429, Response Text: {"status":429,"href":null,"error_message":"You have exceeded your api key request quota for this account","error":"too_many_requests"}' after 2 tries. Waiting 10 seconds then retrying...
2024

Need to find a way to improve the connector so it doesn't break the API limit all the time.