mozilla / bigquery-etl

Bigquery ETL
https://mozilla.github.io/bigquery-etl
Mozilla Public License 2.0
241 stars 98 forks source link

DENG-3096 Cloudflare - Browser Usage #5825

Closed kwindau closed 1 week ago

kwindau commented 1 week ago

Checklist for reviewer:

For modifications to schemas in restricted namespaces (see CODEOWNERS):

┆Issue is synchronized with this Jira Task

dataops-ci-bot commented 1 week ago

Integration report for "DENG-3096 fix data type in errors table"

sql.diff

Click to expand! ```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/browser_usage_v1/query.py /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/browser_usage_v1/query.py --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/browser_usage_v1/query.py 2024-06-21 14:05:10.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/browser_usage_v1/query.py 2024-06-21 14:05:04.000000000 +0000 @@ -327,8 +327,8 @@ create_disposition="CREATE_IF_NEEDED", write_disposition="WRITE_TRUNCATE", schema=[ - {"name": "StartTime", "type": "TIMESTAMP", "mode": "REQUIRED"}, - {"name": "EndTime", "type": "TIMESTAMP", "mode": "REQUIRED"}, + {"name": "StartTime", "type": "DATE", "mode": "REQUIRED"}, + {"name": "EndTime", "type": "DATE", "mode": "REQUIRED"}, {"name": "Location", "type": "STRING", "mode": "NULLABLE"}, {"name": "UserType", "type": "STRING", "mode": "NULLABLE"}, {"name": "DeviceType", "type": "STRING", "mode": "NULLABLE"}, ```

Link to full diff

dataops-ci-bot commented 1 week ago

Integration report for "Merge branch 'main' into cloudflare-browser"

sql.diff

Click to expand! ```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/browser_usage_v1/query.py /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/browser_usage_v1/query.py --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/browser_usage_v1/query.py 2024-06-21 15:14:23.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/cloudflare_derived/browser_usage_v1/query.py 2024-06-21 15:14:15.000000000 +0000 @@ -327,8 +327,8 @@ create_disposition="CREATE_IF_NEEDED", write_disposition="WRITE_TRUNCATE", schema=[ - {"name": "StartTime", "type": "TIMESTAMP", "mode": "REQUIRED"}, - {"name": "EndTime", "type": "TIMESTAMP", "mode": "REQUIRED"}, + {"name": "StartTime", "type": "DATE", "mode": "REQUIRED"}, + {"name": "EndTime", "type": "DATE", "mode": "REQUIRED"}, {"name": "Location", "type": "STRING", "mode": "NULLABLE"}, {"name": "UserType", "type": "STRING", "mode": "NULLABLE"}, {"name": "DeviceType", "type": "STRING", "mode": "NULLABLE"}, ```

Link to full diff