The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
2022-03-19 21:52:58 source > Giving up for returned HTTP status: 401
2022-03-19 21:52:58 source > Giving up _send(...) after 1 tries (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)
Steps to Reproduce
Overwrite the should_retry method in your HttpStream to include a status between 400 and 500 other than 429.
Run your stream, so it encounters this error status.
Environment
Current Behavior
The source
should_retry
method evaluates to True, but the request is never retried becauseshould_give_up
inrate_limiting.py
evaluates to True.Expected Behavior
If
should_retry
evaluates to True the request should be retried.Logs
logs-50.txt
Steps to Reproduce
should_retry
method in yourHttpStream
to include a status between400
and500
other than429
.Are you willing to submit a PR?
Yes