mozilla / bigquery-etl

Bigquery ETL
https://mozilla.github.io/bigquery-etl
Mozilla Public License 2.0
253 stars 100 forks source link

adding retries and decreasing delay #5871

Closed chelseybeck closed 3 months ago

chelseybeck commented 3 months ago

The Braze DAG fails intermittently. Increasing the number of retries for less manual intervention.

Checklist for reviewer:

For modifications to schemas in restricted namespaces (see CODEOWNERS):

┆Issue is synchronized with this Jira Task

dataops-ci-bot commented 3 months ago

Integration report for "Merge branch 'main' into DENG-4215-add-retries"

sql.diff

Click to expand! ```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/dags/bqetl_braze.py /tmp/workspace/generated-sql/dags/bqetl_braze.py --- /tmp/workspace/main-generated-sql/dags/bqetl_braze.py 2024-06-28 22:30:04.000000000 +0000 +++ /tmp/workspace/generated-sql/dags/bqetl_braze.py 2024-06-28 22:29:55.000000000 +0000 @@ -39,10 +39,10 @@ "end_date": None, "email": ["cbeck@mozilla.com", "leli@mozilla.com"], "depends_on_past": False, - "retry_delay": datetime.timedelta(seconds=1800), + "retry_delay": datetime.timedelta(seconds=300), "email_on_failure": True, "email_on_retry": True, - "retries": 1, + "retries": 3, } tags = ["impact/tier_2", "repo/bigquery-etl"] ```

Link to full diff