mozilla / bigquery-etl

Bigquery ETL
https://mozilla.github.io/bigquery-etl
Mozilla Public License 2.0
241 stars 98 forks source link

PPA measurements view #5858

Closed curtismorales closed 2 days ago

curtismorales commented 3 days ago

Pulls PPA measurements data into shared-prod for reporting

Checklist for reviewer:

For modifications to schemas in restricted namespaces (see CODEOWNERS):

┆Issue is synchronized with this Jira Task

dataops-ci-bot commented 3 days ago

Integration report for "Merge branch 'ppa-view' of github.com:mozilla/bigquery-etl into ppa-view"

sql.diff

Click to expand! ```diff Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads: ppa_measurements diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml 1970-01-01 00:00:00.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml 2024-06-27 20:12:44.000000000 +0000 @@ -0,0 +1,21 @@ +friendly_name: PPA Measurements +description: |- + Aggregated conversion data from PPA (Privacy-Preserving Attribution) + + This data lives in the moz-fx-ads-nonprod project and is generated by the + PPA DAP Collector job (dap_collector_ppa_dev DAG, defined in + telemetry-airflow and docker-etl) + + Temporarily pointed at the dev instance of this data; will point to prod once + that exists +owners: + - cmorales@mozilla.com +workgroup_access: + - role: roles/bigquery.dataViewer + members: + - workgroup:ads + +# Generated by bigquery_etl.dependency +references: + view.sql: + - moz-fx-ads-nonprod.ppa_dev.measurements diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql 1970-01-01 00:00:00.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql 2024-06-27 20:11:43.000000000 +0000 @@ -0,0 +1,7 @@ +CREATE OR REPLACE VIEW + `moz-fx-data-shared-prod.ads.ppa_measurements` +AS +SELECT + * +FROM + `moz-fx-ads-nonprod.ppa_dev.measurements` ```

Link to full diff

dataops-ci-bot commented 3 days ago

Integration report for "Merge branch 'main' into ppa-view"

sql.diff

Click to expand! ```diff Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads: ppa_measurements diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml 1970-01-01 00:00:00.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml 2024-06-27 22:30:18.000000000 +0000 @@ -0,0 +1,21 @@ +friendly_name: PPA Measurements +description: |- + Aggregated conversion data from PPA (Privacy-Preserving Attribution) + + This data lives in the moz-fx-ads-nonprod project and is generated by the + PPA DAP Collector job (dap_collector_ppa_dev DAG, defined in + telemetry-airflow and docker-etl) + + Temporarily pointed at the dev instance of this data; will point to prod once + that exists +owners: + - cmorales@mozilla.com +workgroup_access: + - role: roles/bigquery.dataViewer + members: + - workgroup:ads + +# Generated by bigquery_etl.dependency +references: + view.sql: + - moz-fx-ads-nonprod.ppa_dev.measurements diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql 1970-01-01 00:00:00.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql 2024-06-27 22:29:20.000000000 +0000 @@ -0,0 +1,7 @@ +CREATE OR REPLACE VIEW + `moz-fx-data-shared-prod.ads.ppa_measurements` +AS +SELECT + * +FROM + `moz-fx-ads-nonprod.ppa_dev.measurements` ```

Link to full diff

dataops-ci-bot commented 2 days ago

Integration report for "Merge branch 'main' into ppa-view"

sql.diff

Click to expand! ```diff Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads: ppa_measurements diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml 1970-01-01 00:00:00.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml 2024-06-28 20:09:31.000000000 +0000 @@ -0,0 +1,21 @@ +friendly_name: PPA Measurements +description: |- + Aggregated conversion data from PPA (Privacy-Preserving Attribution) + + This data lives in the moz-fx-ads-nonprod project and is generated by the + PPA DAP Collector job (dap_collector_ppa_dev DAG, defined in + telemetry-airflow and docker-etl) + + Temporarily pointed at the dev instance of this data; will point to prod once + that exists +owners: + - cmorales@mozilla.com +workgroup_access: + - role: roles/bigquery.dataViewer + members: + - workgroup:ads + +# Generated by bigquery_etl.dependency +references: + view.sql: + - moz-fx-ads-nonprod.ppa_dev.measurements diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql 1970-01-01 00:00:00.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql 2024-06-28 20:08:32.000000000 +0000 @@ -0,0 +1,7 @@ +CREATE OR REPLACE VIEW + `moz-fx-data-shared-prod.ads.ppa_measurements` +AS +SELECT + * +FROM + `moz-fx-ads-nonprod.ppa_dev.measurements` ```

Link to full diff

dataops-ci-bot commented 2 days ago

Integration report for "Merge branch 'main' into ppa-view"

sql.diff

Click to expand! ```diff Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads: ppa_measurements diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml 1970-01-01 00:00:00.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/metadata.yaml 2024-06-28 22:55:55.000000000 +0000 @@ -0,0 +1,21 @@ +friendly_name: PPA Measurements +description: |- + Aggregated conversion data from PPA (Privacy-Preserving Attribution) + + This data lives in the moz-fx-ads-nonprod project and is generated by the + PPA DAP Collector job (dap_collector_ppa_dev DAG, defined in + telemetry-airflow and docker-etl) + + Temporarily pointed at the dev instance of this data; will point to prod once + that exists +owners: + - cmorales@mozilla.com +workgroup_access: + - role: roles/bigquery.dataViewer + members: + - workgroup:ads + +# Generated by bigquery_etl.dependency +references: + view.sql: + - moz-fx-ads-nonprod.ppa_dev.measurements diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql 1970-01-01 00:00:00.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/ads/ppa_measurements/view.sql 2024-06-28 22:55:00.000000000 +0000 @@ -0,0 +1,7 @@ +CREATE OR REPLACE VIEW + `moz-fx-data-shared-prod.ads.ppa_measurements` +AS +SELECT + * +FROM + `moz-fx-ads-nonprod.ppa_dev.measurements` ```

Link to full diff