mozilla / bigquery-etl

Bigquery ETL
https://mozilla.github.io/bigquery-etl
Mozilla Public License 2.0
241 stars 98 forks source link

Add new columns to www_site_hits_v2 & www_site_downloads_v2 #5839

Closed kwindau closed 5 days ago

kwindau commented 5 days ago

Checklist for reviewer:

For modifications to schemas in restricted namespaces (see CODEOWNERS):

┆Issue is synchronized with this Jira Task

dataops-ci-bot commented 5 days ago

Integration report for "Add new columns to www_site_hits_v2"

sql.diff

Click to expand! ```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql 2024-06-25 20:13:09.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql 2024-06-25 20:13:03.000000000 +0000 @@ -52,6 +52,11 @@ device.web_info.browser AS browser, device.web_info.browser_version AS browser_version, geo.country AS country, + traffic_source.name AS traffic_source_name, + traffic_source.medium AS traffic_source_medium, + traffic_source.source AS traffic_source_source, + collected_traffic_source.manual_campaign_id AS manual_campaign_id, + collected_traffic_source.manual_term AS manual_term, collected_traffic_source.manual_source AS source, collected_traffic_source.manual_medium AS medium, collected_traffic_source.manual_campaign_name AS campaign, @@ -119,6 +124,11 @@ a.browser, a.browser_version, a.country, + a.traffic_source_name, + a.traffic_source_medium, + a.traffic_source_source, + a.manual_campaign_id, + a.manual_term, a.source, a.medium, a.campaign, @@ -194,6 +204,11 @@ all_events.browser, all_events.browser_version, all_events.country, + all_events.traffic_source_name, + all_events.traffic_source_medium, + all_events.traffic_source_source, + all_events.manual_campaign_id, + all_events.manual_term, all_events.source, all_events.medium, all_events.campaign, @@ -271,6 +286,11 @@ final.browser, final.browser_version, final.country, + final.traffic_source_name, + final.traffic_source_medium, + final.traffic_source_source, + final.manual_campaign_id, + final.manual_term, final.source, final.medium, final.campaign, diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml 2024-06-25 20:13:09.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml 2024-06-25 20:13:03.000000000 +0000 @@ -84,21 +84,41 @@ type: STRING description: Country - The country from which events were reported, based on IP address - mode: NULLABLE + name: traffic_source_name + type: STRING + description: Traffic Source - Name +- mode: NULLABLE + name: traffic_source_medium + type: STRING + description: Traffic Source - Medium +- mode: NULLABLE + name: traffic_source_source + type: STRING + description: Traffic Source - Source +- mode: NULLABLE + name: manual_campaign_id + type: STRING + description: Manual Campaign ID (comes from collected traffic source) +- mode: NULLABLE + name: manual_term + type: STRING + description: Manual Term (comes from collected traffic source) +- mode: NULLABLE name: source type: STRING - description: Source - Referring partner domain + description: Source - Referring partner domain (comes from collected traffic source) - mode: NULLABLE name: medium type: STRING - description: Medium - Category of the source, such as 'organic' for a search engine + description: Medium - Category of the source, such as 'organic' for a search engine (comes from collected traffic source) - mode: NULLABLE name: campaign type: STRING - description: Campaign - Identifier for the marketing campaign + description: Campaign - Identifier for the marketing campaign (comes from collected traffic source) - mode: NULLABLE name: ad_content type: STRING - description: Ad Content - Indicates the particular link within a campaign + description: Ad Content - Indicates the particular link within a campaign (comes from collected traffic source) - mode: NULLABLE name: visits type: INT64 diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/search_derived/search_clients_daily_v8/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/search_derived/search_clients_daily_v8/schema.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/search_derived/search_clients_daily_v8/schema.yaml 2024-06-25 20:13:09.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/search_derived/search_clients_daily_v8/schema.yaml 2024-06-25 20:13:03.000000000 +0000 @@ -18,9 +18,6 @@ name: addon_version type: STRING - mode: NULLABLE - name: has_adblocker_addon - type: STRING -- mode: NULLABLE name: app_version type: STRING - mode: NULLABLE ```

Link to full diff

dataops-ci-bot commented 5 days ago

Integration report for "Merge branch 'main' into add-new-cols-to-www-site-hits-v2"

sql.diff

Click to expand! ```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql 2024-06-25 20:24:46.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql 2024-06-25 20:24:43.000000000 +0000 @@ -52,6 +52,11 @@ device.web_info.browser AS browser, device.web_info.browser_version AS browser_version, geo.country AS country, + traffic_source.name AS traffic_source_name, + traffic_source.medium AS traffic_source_medium, + traffic_source.source AS traffic_source_source, + collected_traffic_source.manual_campaign_id AS manual_campaign_id, + collected_traffic_source.manual_term AS manual_term, collected_traffic_source.manual_source AS source, collected_traffic_source.manual_medium AS medium, collected_traffic_source.manual_campaign_name AS campaign, @@ -119,6 +124,11 @@ a.browser, a.browser_version, a.country, + a.traffic_source_name, + a.traffic_source_medium, + a.traffic_source_source, + a.manual_campaign_id, + a.manual_term, a.source, a.medium, a.campaign, @@ -194,6 +204,11 @@ all_events.browser, all_events.browser_version, all_events.country, + all_events.traffic_source_name, + all_events.traffic_source_medium, + all_events.traffic_source_source, + all_events.manual_campaign_id, + all_events.manual_term, all_events.source, all_events.medium, all_events.campaign, @@ -271,6 +286,11 @@ final.browser, final.browser_version, final.country, + final.traffic_source_name, + final.traffic_source_medium, + final.traffic_source_source, + final.manual_campaign_id, + final.manual_term, final.source, final.medium, final.campaign, diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml 2024-06-25 20:24:46.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml 2024-06-25 20:24:43.000000000 +0000 @@ -84,21 +84,41 @@ type: STRING description: Country - The country from which events were reported, based on IP address - mode: NULLABLE + name: traffic_source_name + type: STRING + description: Traffic Source - Name +- mode: NULLABLE + name: traffic_source_medium + type: STRING + description: Traffic Source - Medium +- mode: NULLABLE + name: traffic_source_source + type: STRING + description: Traffic Source - Source +- mode: NULLABLE + name: manual_campaign_id + type: STRING + description: Manual Campaign ID (comes from collected traffic source) +- mode: NULLABLE + name: manual_term + type: STRING + description: Manual Term (comes from collected traffic source) +- mode: NULLABLE name: source type: STRING - description: Source - Referring partner domain + description: Source - Referring partner domain (comes from collected traffic source) - mode: NULLABLE name: medium type: STRING - description: Medium - Category of the source, such as 'organic' for a search engine + description: Medium - Category of the source, such as 'organic' for a search engine (comes from collected traffic source) - mode: NULLABLE name: campaign type: STRING - description: Campaign - Identifier for the marketing campaign + description: Campaign - Identifier for the marketing campaign (comes from collected traffic source) - mode: NULLABLE name: ad_content type: STRING - description: Ad Content - Indicates the particular link within a campaign + description: Ad Content - Indicates the particular link within a campaign (comes from collected traffic source) - mode: NULLABLE name: visits type: INT64 ```

Link to full diff

dataops-ci-bot commented 5 days ago

Integration report for "Add new cols to www_site_downloads_v2"

sql.diff

Click to expand! ```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/query.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/query.sql 2024-06-25 20:41:09.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/query.sql 2024-06-25 20:41:19.000000000 +0000 @@ -6,6 +6,11 @@ operating_system, `language`, country, + traffic_source_name, + traffic_source_medium, + traffic_source_source, + manual_campaign_id, + manual_term, source, medium, campaign, @@ -42,6 +47,13 @@ device.operating_system AS operating_system, device.language AS `language`, geo.country AS country, + --below is new + traffic_source.name AS traffic_source_name, + traffic_source.medium AS traffic_source_medium, + traffic_source.source AS traffic_source_source, + collected_traffic_source.manual_campaign_id AS manual_campaign_id, + collected_traffic_source.manual_term AS manual_term, + --above is new collected_traffic_source.manual_source AS source, collected_traffic_source.manual_medium AS medium, collected_traffic_source.manual_campaign_name AS campaign, @@ -84,6 +96,11 @@ operating_system, `language`, country, + traffic_source_name, + traffic_source_medium, + traffic_source_source, + manual_campaign_id, + manual_term, source, medium, campaign, @@ -97,6 +114,11 @@ operating_system, `language`, country, + traffic_source_name, + traffic_source_medium, + traffic_source_source, + manual_campaign_id, + manual_term, source, medium, campaign, diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/schema.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/schema.yaml 2024-06-25 20:41:09.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/schema.yaml 2024-06-25 20:41:19.000000000 +0000 @@ -24,6 +24,26 @@ type: STRING description: Country - The country from which events were reported, based on IP address - mode: NULLABLE + name: traffic_source_name + type: STRING + description: Traffic Source - Name +- mode: NULLABLE + name: traffic_source_medium + type: STRING + description: Traffic Source - Medium +- mode: NULLABLE + name: traffic_source_source + type: STRING + description: Traffic Source - Source +- mode: NULLABLE + name: manual_campaign_id + type: STRING + description: Manual Campaign ID (comes from collected traffic source) +- mode: NULLABLE + name: manual_term + type: STRING + description: Manual Term (comes from collected traffic source) +- mode: NULLABLE name: source type: STRING description: Source - Referring partner domain diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql 2024-06-25 20:41:09.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql 2024-06-25 20:41:19.000000000 +0000 @@ -52,6 +52,11 @@ device.web_info.browser AS browser, device.web_info.browser_version AS browser_version, geo.country AS country, + traffic_source.name AS traffic_source_name, + traffic_source.medium AS traffic_source_medium, + traffic_source.source AS traffic_source_source, + collected_traffic_source.manual_campaign_id AS manual_campaign_id, + collected_traffic_source.manual_term AS manual_term, collected_traffic_source.manual_source AS source, collected_traffic_source.manual_medium AS medium, collected_traffic_source.manual_campaign_name AS campaign, @@ -119,6 +124,11 @@ a.browser, a.browser_version, a.country, + a.traffic_source_name, + a.traffic_source_medium, + a.traffic_source_source, + a.manual_campaign_id, + a.manual_term, a.source, a.medium, a.campaign, @@ -194,6 +204,11 @@ all_events.browser, all_events.browser_version, all_events.country, + all_events.traffic_source_name, + all_events.traffic_source_medium, + all_events.traffic_source_source, + all_events.manual_campaign_id, + all_events.manual_term, all_events.source, all_events.medium, all_events.campaign, @@ -271,6 +286,11 @@ final.browser, final.browser_version, final.country, + final.traffic_source_name, + final.traffic_source_medium, + final.traffic_source_source, + final.manual_campaign_id, + final.manual_term, final.source, final.medium, final.campaign, diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml 2024-06-25 20:41:09.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml 2024-06-25 20:41:19.000000000 +0000 @@ -84,21 +84,41 @@ type: STRING description: Country - The country from which events were reported, based on IP address - mode: NULLABLE + name: traffic_source_name + type: STRING + description: Traffic Source - Name +- mode: NULLABLE + name: traffic_source_medium + type: STRING + description: Traffic Source - Medium +- mode: NULLABLE + name: traffic_source_source + type: STRING + description: Traffic Source - Source +- mode: NULLABLE + name: manual_campaign_id + type: STRING + description: Manual Campaign ID (comes from collected traffic source) +- mode: NULLABLE + name: manual_term + type: STRING + description: Manual Term (comes from collected traffic source) +- mode: NULLABLE name: source type: STRING - description: Source - Referring partner domain + description: Source - Referring partner domain (comes from collected traffic source) - mode: NULLABLE name: medium type: STRING - description: Medium - Category of the source, such as 'organic' for a search engine + description: Medium - Category of the source, such as 'organic' for a search engine (comes from collected traffic source) - mode: NULLABLE name: campaign type: STRING - description: Campaign - Identifier for the marketing campaign + description: Campaign - Identifier for the marketing campaign (comes from collected traffic source) - mode: NULLABLE name: ad_content type: STRING - description: Ad Content - Indicates the particular link within a campaign + description: Ad Content - Indicates the particular link within a campaign (comes from collected traffic source) - mode: NULLABLE name: visits type: INT64 ```

Link to full diff

dataops-ci-bot commented 5 days ago

Integration report for "Remove comments"

sql.diff

Click to expand! ```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/query.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/query.sql 2024-06-25 20:41:26.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/query.sql 2024-06-25 20:41:35.000000000 +0000 @@ -6,6 +6,11 @@ operating_system, `language`, country, + traffic_source_name, + traffic_source_medium, + traffic_source_source, + manual_campaign_id, + manual_term, source, medium, campaign, @@ -42,6 +47,11 @@ device.operating_system AS operating_system, device.language AS `language`, geo.country AS country, + traffic_source.name AS traffic_source_name, + traffic_source.medium AS traffic_source_medium, + traffic_source.source AS traffic_source_source, + collected_traffic_source.manual_campaign_id AS manual_campaign_id, + collected_traffic_source.manual_term AS manual_term, collected_traffic_source.manual_source AS source, collected_traffic_source.manual_medium AS medium, collected_traffic_source.manual_campaign_name AS campaign, @@ -84,6 +94,11 @@ operating_system, `language`, country, + traffic_source_name, + traffic_source_medium, + traffic_source_source, + manual_campaign_id, + manual_term, source, medium, campaign, @@ -97,6 +112,11 @@ operating_system, `language`, country, + traffic_source_name, + traffic_source_medium, + traffic_source_source, + manual_campaign_id, + manual_term, source, medium, campaign, diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/schema.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/schema.yaml 2024-06-25 20:41:26.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/schema.yaml 2024-06-25 20:41:35.000000000 +0000 @@ -24,6 +24,26 @@ type: STRING description: Country - The country from which events were reported, based on IP address - mode: NULLABLE + name: traffic_source_name + type: STRING + description: Traffic Source - Name +- mode: NULLABLE + name: traffic_source_medium + type: STRING + description: Traffic Source - Medium +- mode: NULLABLE + name: traffic_source_source + type: STRING + description: Traffic Source - Source +- mode: NULLABLE + name: manual_campaign_id + type: STRING + description: Manual Campaign ID (comes from collected traffic source) +- mode: NULLABLE + name: manual_term + type: STRING + description: Manual Term (comes from collected traffic source) +- mode: NULLABLE name: source type: STRING description: Source - Referring partner domain diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql 2024-06-25 20:41:26.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql 2024-06-25 20:41:35.000000000 +0000 @@ -52,6 +52,11 @@ device.web_info.browser AS browser, device.web_info.browser_version AS browser_version, geo.country AS country, + traffic_source.name AS traffic_source_name, + traffic_source.medium AS traffic_source_medium, + traffic_source.source AS traffic_source_source, + collected_traffic_source.manual_campaign_id AS manual_campaign_id, + collected_traffic_source.manual_term AS manual_term, collected_traffic_source.manual_source AS source, collected_traffic_source.manual_medium AS medium, collected_traffic_source.manual_campaign_name AS campaign, @@ -119,6 +124,11 @@ a.browser, a.browser_version, a.country, + a.traffic_source_name, + a.traffic_source_medium, + a.traffic_source_source, + a.manual_campaign_id, + a.manual_term, a.source, a.medium, a.campaign, @@ -194,6 +204,11 @@ all_events.browser, all_events.browser_version, all_events.country, + all_events.traffic_source_name, + all_events.traffic_source_medium, + all_events.traffic_source_source, + all_events.manual_campaign_id, + all_events.manual_term, all_events.source, all_events.medium, all_events.campaign, @@ -271,6 +286,11 @@ final.browser, final.browser_version, final.country, + final.traffic_source_name, + final.traffic_source_medium, + final.traffic_source_source, + final.manual_campaign_id, + final.manual_term, final.source, final.medium, final.campaign, diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml 2024-06-25 20:41:26.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml 2024-06-25 20:41:35.000000000 +0000 @@ -84,21 +84,41 @@ type: STRING description: Country - The country from which events were reported, based on IP address - mode: NULLABLE + name: traffic_source_name + type: STRING + description: Traffic Source - Name +- mode: NULLABLE + name: traffic_source_medium + type: STRING + description: Traffic Source - Medium +- mode: NULLABLE + name: traffic_source_source + type: STRING + description: Traffic Source - Source +- mode: NULLABLE + name: manual_campaign_id + type: STRING + description: Manual Campaign ID (comes from collected traffic source) +- mode: NULLABLE + name: manual_term + type: STRING + description: Manual Term (comes from collected traffic source) +- mode: NULLABLE name: source type: STRING - description: Source - Referring partner domain + description: Source - Referring partner domain (comes from collected traffic source) - mode: NULLABLE name: medium type: STRING - description: Medium - Category of the source, such as 'organic' for a search engine + description: Medium - Category of the source, such as 'organic' for a search engine (comes from collected traffic source) - mode: NULLABLE name: campaign type: STRING - description: Campaign - Identifier for the marketing campaign + description: Campaign - Identifier for the marketing campaign (comes from collected traffic source) - mode: NULLABLE name: ad_content type: STRING - description: Ad Content - Indicates the particular link within a campaign + description: Ad Content - Indicates the particular link within a campaign (comes from collected traffic source) - mode: NULLABLE name: visits type: INT64 ```

Link to full diff

dataops-ci-bot commented 5 days ago

Integration report for "Update column descriptions to clarify which are CTS vs TS"

sql.diff

Click to expand! ```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/query.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/query.sql 2024-06-25 20:41:39.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/query.sql 2024-06-25 20:41:29.000000000 +0000 @@ -6,6 +6,11 @@ operating_system, `language`, country, + traffic_source_name, + traffic_source_medium, + traffic_source_source, + manual_campaign_id, + manual_term, source, medium, campaign, @@ -42,6 +47,11 @@ device.operating_system AS operating_system, device.language AS `language`, geo.country AS country, + traffic_source.name AS traffic_source_name, + traffic_source.medium AS traffic_source_medium, + traffic_source.source AS traffic_source_source, + collected_traffic_source.manual_campaign_id AS manual_campaign_id, + collected_traffic_source.manual_term AS manual_term, collected_traffic_source.manual_source AS source, collected_traffic_source.manual_medium AS medium, collected_traffic_source.manual_campaign_name AS campaign, @@ -84,6 +94,11 @@ operating_system, `language`, country, + traffic_source_name, + traffic_source_medium, + traffic_source_source, + manual_campaign_id, + manual_term, source, medium, campaign, @@ -97,6 +112,11 @@ operating_system, `language`, country, + traffic_source_name, + traffic_source_medium, + traffic_source_source, + manual_campaign_id, + manual_term, source, medium, campaign, diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/schema.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/schema.yaml 2024-06-25 20:41:39.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v2/schema.yaml 2024-06-25 20:41:29.000000000 +0000 @@ -24,21 +24,41 @@ type: STRING description: Country - The country from which events were reported, based on IP address - mode: NULLABLE + name: traffic_source_name + type: STRING + description: Traffic Source - Name +- mode: NULLABLE + name: traffic_source_medium + type: STRING + description: Traffic Source - Medium +- mode: NULLABLE + name: traffic_source_source + type: STRING + description: Traffic Source - Source +- mode: NULLABLE + name: manual_campaign_id + type: STRING + description: Manual Campaign ID (comes from collected traffic source) +- mode: NULLABLE + name: manual_term + type: STRING + description: Manual Term (comes from collected traffic source) +- mode: NULLABLE name: source type: STRING - description: Source - Referring partner domain + description: Source - Referring partner domain (comes from collected traffic source) - mode: NULLABLE name: medium type: STRING - description: Medium - Category of the source, such as 'organic' for a search engine + description: Medium - Category of the source, such as 'organic' for a search engine (comes from collected traffic source) - mode: NULLABLE name: campaign type: STRING - description: Campaign - Identifier for the marketing campaign + description: Campaign - Identifier for the marketing campaign (comes from collected traffic source) - mode: NULLABLE name: ad_content type: STRING - description: Ad Content - Indicates the particular link within a campaign + description: Ad Content - Indicates the particular link within a campaign (comes from collected traffic source) - mode: NULLABLE name: browser type: STRING diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql 2024-06-25 20:41:39.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/query.sql 2024-06-25 20:41:29.000000000 +0000 @@ -52,6 +52,11 @@ device.web_info.browser AS browser, device.web_info.browser_version AS browser_version, geo.country AS country, + traffic_source.name AS traffic_source_name, + traffic_source.medium AS traffic_source_medium, + traffic_source.source AS traffic_source_source, + collected_traffic_source.manual_campaign_id AS manual_campaign_id, + collected_traffic_source.manual_term AS manual_term, collected_traffic_source.manual_source AS source, collected_traffic_source.manual_medium AS medium, collected_traffic_source.manual_campaign_name AS campaign, @@ -119,6 +124,11 @@ a.browser, a.browser_version, a.country, + a.traffic_source_name, + a.traffic_source_medium, + a.traffic_source_source, + a.manual_campaign_id, + a.manual_term, a.source, a.medium, a.campaign, @@ -194,6 +204,11 @@ all_events.browser, all_events.browser_version, all_events.country, + all_events.traffic_source_name, + all_events.traffic_source_medium, + all_events.traffic_source_source, + all_events.manual_campaign_id, + all_events.manual_term, all_events.source, all_events.medium, all_events.campaign, @@ -271,6 +286,11 @@ final.browser, final.browser_version, final.country, + final.traffic_source_name, + final.traffic_source_medium, + final.traffic_source_source, + final.manual_campaign_id, + final.manual_term, final.source, final.medium, final.campaign, diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml 2024-06-25 20:41:39.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v2/schema.yaml 2024-06-25 20:41:29.000000000 +0000 @@ -84,21 +84,41 @@ type: STRING description: Country - The country from which events were reported, based on IP address - mode: NULLABLE + name: traffic_source_name + type: STRING + description: Traffic Source - Name +- mode: NULLABLE + name: traffic_source_medium + type: STRING + description: Traffic Source - Medium +- mode: NULLABLE + name: traffic_source_source + type: STRING + description: Traffic Source - Source +- mode: NULLABLE + name: manual_campaign_id + type: STRING + description: Manual Campaign ID (comes from collected traffic source) +- mode: NULLABLE + name: manual_term + type: STRING + description: Manual Term (comes from collected traffic source) +- mode: NULLABLE name: source type: STRING - description: Source - Referring partner domain + description: Source - Referring partner domain (comes from collected traffic source) - mode: NULLABLE name: medium type: STRING - description: Medium - Category of the source, such as 'organic' for a search engine + description: Medium - Category of the source, such as 'organic' for a search engine (comes from collected traffic source) - mode: NULLABLE name: campaign type: STRING - description: Campaign - Identifier for the marketing campaign + description: Campaign - Identifier for the marketing campaign (comes from collected traffic source) - mode: NULLABLE name: ad_content type: STRING - description: Ad Content - Indicates the particular link within a campaign + description: Ad Content - Indicates the particular link within a campaign (comes from collected traffic source) - mode: NULLABLE name: visits type: INT64 ```

Link to full diff