Amplitude Benefits: 404 causing DAG failure

cal-itp / data-infra

Cal-ITP data infrastructure

https://docs.calitp.org/data-infra

GNU Affero General Public License v3.0

48 stars 14 forks source link

Amplitude Benefits: 404 causing DAG failure #1682

Closed angela-tran closed 2 years ago

angela-tran commented 2 years ago

Starting around August 5, we have been seeing this error in the amplitude_benefits.api_to_jsonl DAG task:

requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://amplitude.com/api/2/export?start=20220805T00&end=20220805T23

Logs

lauriemerrell commented 2 years ago

FYI @angela-tran @machikoyasuda @thekaveman -- this seemingly did not happen today, after happening every day for several days 👀 Possible they fixed it on their side?

angela-tran commented 2 years ago

I think we should update our operator to be ok with a 404 response code as it seems to indicate that there's no data rather than an actual error.

From https://www.docs.developers.amplitude.com/analytics/apis/export-api/#status-codes,

404 | No data available for the time range requested.