DENG-2492 Deprecate GA3 tables since GA3 feed ending 2024-06-30

Checklist for reviewer:

[ ] Commits should reference a bug or github issue, if relevant (if a bug is referenced, the pull request should include the bug number in the title).
[ ] If the PR comes from a fork, trigger integration CI tests by running the Push to upstream workflow and provide the <username>:<branch> of the fork as parameter. The parameter will also show up in the logs of the manual-trigger-required-for-fork CI task together with more detailed instructions.
[ ] If adding a new field to a query, ensure that the schema and dependent downstream schemas have been updated.
[ ] When adding a new derived dataset, ensure that data is not available already (fully or partially) and recommend extending an existing dataset in favor of creating new ones. Data can be available in the bigquery-etl repository, looker-hub or in looker-spoke-default.

For modifications to schemas in restricted namespaces (see CODEOWNERS):

[ ] Follow the change control procedure

┆Issue is synchronized with this Jira Task

Integration report for "Deprecate GA3 tables since GA3 feed ending 2024-06-30"

`sql.diff`

Click to expand!

```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml 2024-06-26 18:59:17.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml 2024-06-26 18:59:40.000000000 +0000 @@ -23,8 +23,6 @@ - browser - blog - subblog -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml 2024-06-26 18:59:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml 2024-06-26 18:59:40.000000000 +0000 @@ -21,8 +21,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml 2024-06-26 18:59:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml 2024-06-26 18:59:40.000000000 +0000 @@ -23,8 +23,6 @@ - browser - blog - subblog -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml 2024-06-26 18:59:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml 2024-06-26 18:59:40.000000000 +0000 @@ -21,8 +21,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml 2024-06-26 18:57:44.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml 2024-06-26 18:59:40.000000000 +0000 @@ -8,8 +8,5 @@ - role: roles/bigquery.dataViewer members: - workgroup:mozilla-confidential -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] syndication: {} diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml 2024-06-26 18:59:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml 2024-06-26 18:59:40.000000000 +0000 @@ -22,10 +22,8 @@ - country - locale - version -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: query.sql: - moz-fx-data-marketing-prod.ga_derived.www_site_hits_v1 +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml 2024-06-26 18:59:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml 2024-06-26 18:59:40.000000000 +0000 @@ -18,8 +18,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml 2024-06-26 18:59:17.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml 2024-06-26 18:59:40.000000000 +0000 @@ -23,8 +23,6 @@ - event_category - event_action - event_label -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml 2024-06-26 18:59:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml 2024-06-26 18:59:40.000000000 +0000 @@ -21,8 +21,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml 2024-06-26 18:59:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml 2024-06-26 18:59:40.000000000 +0000 @@ -23,8 +23,6 @@ - country - locale - medium -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml 2024-06-26 18:59:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml 2024-06-26 18:59:40.000000000 +0000 @@ -23,8 +23,6 @@ - browser - source - medium -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml 2024-06-26 18:59:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml 2024-06-26 18:59:40.000000000 +0000 @@ -23,8 +23,6 @@ - country - locale - medium -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml 2024-06-26 18:57:44.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml 2024-06-26 18:59:52.000000000 +0000 @@ -8,7 +8,5 @@ - role: roles/bigquery.dataViewer members: - workgroup:mozilla-confidential -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] +syndication: {} diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml 2024-06-26 18:59:25.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml 2024-06-26 18:59:52.000000000 +0000 @@ -20,8 +20,6 @@ clustering: fields: - first_seen_date -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml 2024-06-26 18:59:25.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml 2024-06-26 18:59:52.000000000 +0000 @@ -30,8 +30,6 @@ clustering: fields: - country -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml 2024-06-26 18:57:44.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml 2024-06-26 18:59:52.000000000 +0000 @@ -9,18 +9,21 @@ - frank@mozilla.com labels: incremental: true - owner1: frank@mozilla.com + owner1: frank + dag: bqetl_mozilla_org_derived scheduling: dag_name: bqetl_mozilla_org_derived date_partition_parameter: activity_date - parameters: ["conversion_window:INT64:30"] + parameters: + - conversion_window:INT64:30 bigquery: time_partitioning: type: day - field: 'activity_date' + field: activity_date require_partition_filter: false expiration_days: null + range_partitioning: null + clustering: null +workgroup_access: [] references: {} -workgroup_access: -- role: roles/bigquery.dataViewer - members: [workgroup:dataops-managed/external-census] +deprecated: true ```

Link to full diff

Can you also add a deletion_date so we can keep track of when these tables can be deleted? (see example)

Integration report for "Deprecate GA3 tables since GA3 feed ending 2024-06-30"

`sql.diff`

Click to expand!

```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml 2024-06-26 19:08:46.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml 2024-06-26 19:08:57.000000000 +0000 @@ -23,8 +23,6 @@ - browser - blog - subblog -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml 2024-06-26 19:08:46.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml 2024-06-26 19:08:57.000000000 +0000 @@ -21,8 +21,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml 2024-06-26 19:08:46.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml 2024-06-26 19:08:57.000000000 +0000 @@ -23,8 +23,6 @@ - browser - blog - subblog -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml 2024-06-26 19:08:46.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml 2024-06-26 19:08:57.000000000 +0000 @@ -21,8 +21,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml 2024-06-26 19:06:56.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml 2024-06-26 19:08:57.000000000 +0000 @@ -8,8 +8,5 @@ - role: roles/bigquery.dataViewer members: - workgroup:mozilla-confidential -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] syndication: {} diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml 2024-06-26 19:08:46.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml 2024-06-26 19:08:57.000000000 +0000 @@ -22,10 +22,8 @@ - country - locale - version -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: query.sql: - moz-fx-data-marketing-prod.ga_derived.www_site_hits_v1 +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml 2024-06-26 19:08:46.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml 2024-06-26 19:08:57.000000000 +0000 @@ -18,8 +18,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml 2024-06-26 19:08:46.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml 2024-06-26 19:08:57.000000000 +0000 @@ -23,8 +23,6 @@ - event_category - event_action - event_label -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml 2024-06-26 19:08:46.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml 2024-06-26 19:08:57.000000000 +0000 @@ -21,8 +21,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml 2024-06-26 19:08:46.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml 2024-06-26 19:08:57.000000000 +0000 @@ -23,8 +23,6 @@ - country - locale - medium -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml 2024-06-26 19:08:46.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml 2024-06-26 19:08:57.000000000 +0000 @@ -23,8 +23,6 @@ - browser - source - medium -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml 2024-06-26 19:08:46.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml 2024-06-26 19:08:57.000000000 +0000 @@ -23,8 +23,6 @@ - country - locale - medium -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml 2024-06-26 19:06:56.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml 2024-06-26 19:09:17.000000000 +0000 @@ -8,7 +8,5 @@ - role: roles/bigquery.dataViewer members: - workgroup:mozilla-confidential -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] +syndication: {} diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml 2024-06-26 19:08:50.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml 2024-06-26 19:09:16.000000000 +0000 @@ -20,8 +20,6 @@ clustering: fields: - first_seen_date -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml 2024-06-26 19:08:50.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml 2024-06-26 19:09:17.000000000 +0000 @@ -30,8 +30,6 @@ clustering: fields: - country -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml 2024-06-26 19:06:57.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml 2024-06-26 19:09:17.000000000 +0000 @@ -9,18 +9,21 @@ - frank@mozilla.com labels: incremental: true - owner1: frank@mozilla.com + owner1: frank + dag: bqetl_mozilla_org_derived scheduling: dag_name: bqetl_mozilla_org_derived date_partition_parameter: activity_date - parameters: ["conversion_window:INT64:30"] + parameters: + - conversion_window:INT64:30 bigquery: time_partitioning: type: day - field: 'activity_date' + field: activity_date require_partition_filter: false expiration_days: null + range_partitioning: null + clustering: null +workgroup_access: [] references: {} -workgroup_access: -- role: roles/bigquery.dataViewer - members: [workgroup:dataops-managed/external-census] +deprecated: true ```

Link to full diff

Integration report for "Keep DAG for now, just pause it"

`sql.diff`

Click to expand!

```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/dags/bqetl_google_analytics_derived.py /tmp/workspace/generated-sql/dags/bqetl_google_analytics_derived.py --- /tmp/workspace/main-generated-sql/dags/bqetl_google_analytics_derived.py 2024-06-26 19:28:30.000000000 +0000 +++ /tmp/workspace/generated-sql/dags/bqetl_google_analytics_derived.py 2024-06-26 19:29:56.000000000 +0000 @@ -17,7 +17,6 @@ #### Description Daily aggregations of data exported from Google Analytics. - The GA export runs at 15:00 UTC, so there's an effective 2-day delay for user activity to appear in these tables. diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml 2024-06-26 19:26:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -23,8 +23,6 @@ - browser - blog - subblog -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_empty_check_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_empty_check_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_empty_check_v1/metadata.yaml 2024-06-26 19:26:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_empty_check_v1/metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -15,10 +15,8 @@ parameters: - submission_date:DATE:{{ds}} bigquery: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: query.sql: - moz-fx-data-marketing-prod.66602784.ga_sessions_* +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml 2024-06-26 19:26:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -21,8 +21,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml 2024-06-26 19:26:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -23,8 +23,6 @@ - browser - blog - subblog -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml 2024-06-26 19:26:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -21,8 +21,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml 2024-06-26 19:24:40.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -8,8 +8,5 @@ - role: roles/bigquery.dataViewer members: - workgroup:mozilla-confidential -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] syndication: {} diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml 2024-06-26 19:26:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -22,10 +22,8 @@ - country - locale - version -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: query.sql: - moz-fx-data-marketing-prod.ga_derived.www_site_hits_v1 +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml 2024-06-26 19:26:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -18,8 +18,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_empty_check_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_empty_check_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_empty_check_v1/metadata.yaml 2024-06-26 19:26:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_empty_check_v1/metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -15,10 +15,8 @@ parameters: - submission_date:DATE:{{ds}} bigquery: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: query.sql: - moz-fx-data-marketing-prod.65789850.ga_sessions_* +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml 2024-06-26 19:26:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -23,8 +23,6 @@ - event_category - event_action - event_label -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml 2024-06-26 19:26:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -21,8 +21,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml 2024-06-26 19:26:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -23,8 +23,6 @@ - country - locale - medium -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml 2024-06-26 19:26:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -23,8 +23,6 @@ - browser - source - medium -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml 2024-06-26 19:26:18.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml 2024-06-26 19:26:45.000000000 +0000 @@ -23,8 +23,6 @@ - country - locale - medium -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml 2024-06-26 19:24:40.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml 2024-06-26 19:27:06.000000000 +0000 @@ -8,7 +8,5 @@ - role: roles/bigquery.dataViewer members: - workgroup:mozilla-confidential -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] +syndication: {} diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml 2024-06-26 19:26:23.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml 2024-06-26 19:27:06.000000000 +0000 @@ -20,8 +20,6 @@ clustering: fields: - first_seen_date -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml 2024-06-26 19:26:23.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml 2024-06-26 19:27:06.000000000 +0000 @@ -30,8 +30,6 @@ clustering: fields: - country -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml 2024-06-26 19:24:41.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml 2024-06-26 19:27:06.000000000 +0000 @@ -9,18 +9,21 @@ - frank@mozilla.com labels: incremental: true - owner1: frank@mozilla.com + owner1: frank + dag: bqetl_mozilla_org_derived scheduling: dag_name: bqetl_mozilla_org_derived date_partition_parameter: activity_date - parameters: ["conversion_window:INT64:30"] + parameters: + - conversion_window:INT64:30 bigquery: time_partitioning: type: day - field: 'activity_date' + field: activity_date require_partition_filter: false expiration_days: null + range_partitioning: null + clustering: null +workgroup_access: [] references: {} -workgroup_access: -- role: roles/bigquery.dataViewer - members: [workgroup:dataops-managed/external-census] +deprecated: true ```

Link to full diff

Integration report for "Update dags.yaml"

`sql.diff`

Click to expand!

```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml 2024-06-26 19:26:43.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -23,8 +23,6 @@ - browser - blog - subblog -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_empty_check_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_empty_check_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_empty_check_v1/metadata.yaml 2024-06-26 19:26:43.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_empty_check_v1/metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -15,10 +15,8 @@ parameters: - submission_date:DATE:{{ds}} bigquery: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: query.sql: - moz-fx-data-marketing-prod.66602784.ga_sessions_* +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml 2024-06-26 19:26:43.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -21,8 +21,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml 2024-06-26 19:26:43.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -23,8 +23,6 @@ - browser - blog - subblog -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml 2024-06-26 19:26:43.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -21,8 +21,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml 2024-06-26 19:25:03.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/dataset_metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -8,8 +8,5 @@ - role: roles/bigquery.dataViewer members: - workgroup:mozilla-confidential -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] syndication: {} diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml 2024-06-26 19:26:43.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -22,10 +22,8 @@ - country - locale - version -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: query.sql: - moz-fx-data-marketing-prod.ga_derived.www_site_hits_v1 +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml 2024-06-26 19:26:43.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -18,8 +18,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_empty_check_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_empty_check_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_empty_check_v1/metadata.yaml 2024-06-26 19:26:43.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_empty_check_v1/metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -15,10 +15,8 @@ parameters: - submission_date:DATE:{{ds}} bigquery: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: query.sql: - moz-fx-data-marketing-prod.65789850.ga_sessions_* +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml 2024-06-26 19:26:43.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -23,8 +23,6 @@ - event_category - event_action - event_label -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml 2024-06-26 19:26:43.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -21,8 +21,6 @@ expiration_days: null range_partitioning: null clustering: null -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml 2024-06-26 19:26:43.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -23,8 +23,6 @@ - country - locale - medium -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml 2024-06-26 19:26:43.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -23,8 +23,6 @@ - browser - source - medium -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml 2024-06-26 19:26:43.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml 2024-06-26 19:27:25.000000000 +0000 @@ -23,8 +23,6 @@ - country - locale - medium -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml 2024-06-26 19:25:03.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/dataset_metadata.yaml 2024-06-26 19:27:43.000000000 +0000 @@ -8,7 +8,5 @@ - role: roles/bigquery.dataViewer members: - workgroup:mozilla-confidential -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] +syndication: {} diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml 2024-06-26 19:26:47.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_clients_v1/metadata.yaml 2024-06-26 19:27:43.000000000 +0000 @@ -20,8 +20,6 @@ clustering: fields: - first_seen_date -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml 2024-06-26 19:26:47.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/ga_sessions_v1/metadata.yaml 2024-06-26 19:27:43.000000000 +0000 @@ -30,8 +30,6 @@ clustering: fields: - country -workgroup_access: -- role: roles/bigquery.dataViewer - members: - - workgroup:mozilla-confidential +workgroup_access: [] references: {} +deprecated: true diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml 2024-06-26 19:25:04.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/mozilla_org_derived/gclid_conversions_v1/metadata.yaml 2024-06-26 19:27:43.000000000 +0000 @@ -9,18 +9,21 @@ - frank@mozilla.com labels: incremental: true - owner1: frank@mozilla.com + owner1: frank + dag: bqetl_mozilla_org_derived scheduling: dag_name: bqetl_mozilla_org_derived date_partition_parameter: activity_date - parameters: ["conversion_window:INT64:30"] + parameters: + - conversion_window:INT64:30 bigquery: time_partitioning: type: day - field: 'activity_date' + field: activity_date require_partition_filter: false expiration_days: null + range_partitioning: null + clustering: null +workgroup_access: [] references: {} -workgroup_access: -- role: roles/bigquery.dataViewer - members: [workgroup:dataops-managed/external-census] +deprecated: true ```

Link to full diff

FYI, I don't think doing this will automatically remove access to the deprecated tables that are in moz-fx-data-marketing-prod, since the tooling isn't automatically managing permissions in that project (which is one of the reasons we agreed at the Data Org work week to migrate away from putting derived tables/views there: DSRE-1681). So if you want to remove access to the deprecated tables in moz-fx-data-marketing-prod you'll probably need to manually edit the associated dataset/table permissions.

mozilla / bigquery-etl