mozilla / bigquery-etl

Bigquery ETL
https://mozilla.github.io/bigquery-etl
Mozilla Public License 2.0
253 stars 100 forks source link

DENG-3096 reduce timeouts #5827

Closed kwindau closed 3 months ago

kwindau commented 3 months ago

Checklist for reviewer:

For modifications to schemas in restricted namespaces (see CODEOWNERS):

┆Issue is synchronized with this Jira Task

dataops-ci-bot commented 3 months ago

Integration report for "DENG-3096 reduce timeouts"

sql.diff

Click to expand! ```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/browser_usage_v1/query.py /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/browser_usage_v1/query.py --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/browser_usage_v1/query.py 2024-06-24 13:26:17.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/browser_usage_v1/query.py 2024-06-24 13:26:17.000000000 +0000 @@ -9,7 +9,7 @@ # Configs brwsr_usg_configs = { - "timeout_limit": 2400, + "timeout_limit": 220, "device_types": ["DESKTOP", "MOBILE", "OTHER", "ALL"], "max_limit": 20, "operating_systems": [ diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/device_usage_v1/query.py /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/device_usage_v1/query.py --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/device_usage_v1/query.py 2024-06-24 13:26:17.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/device_usage_v1/query.py 2024-06-24 13:26:17.000000000 +0000 @@ -9,7 +9,7 @@ # Configs device_usg_configs = { - "timeout_limit": 2400, + "timeout_limit": 500, "locations": [ "ALL", "BE", diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/os_usage_v1/query.py /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/os_usage_v1/query.py --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/os_usage_v1/query.py 2024-06-24 13:26:17.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/os_usage_v1/query.py 2024-06-24 13:26:17.000000000 +0000 @@ -9,7 +9,7 @@ # Configurations os_usg_configs = { - "timeout_limit": 2500, + "timeout_limit": 500, "device_types": ["DESKTOP", "MOBILE", "OTHER", "ALL"], "locations": [ "ALL", ```

Link to full diff