DENG-4446 Add "profile_group_id", & update schema.yaml and query.sql to match the current order of columns deployed in BQ prod table

[kwindau]

Checklist for reviewer:

• [ ] Commits should reference a bug or github issue, if relevant (if a bug is referenced, the pull request should include the bug number in the title).
• [ ] If the PR comes from a fork, trigger integration CI tests by running the Push to upstream workflow and provide the <username>:<branch> of the fork as parameter. The parameter will also show up in the logs of the manual-trigger-required-for-fork CI task together with more detailed instructions.
• [ ] If adding a new field to a query, ensure that the schema and dependent downstream schemas have been updated.
• [ ] When adding a new derived dataset, ensure that data is not available already (fully or partially) and recommend extending an existing dataset in favor of creating new ones. Data can be available in the bigquery-etl repository, looker-hub or in looker-spoke-default.

For modifications to schemas in restricted namespaces (see CODEOWNERS):

• [ ] Follow the change control procedure

┆Issue is synchronized with this Jira Task

[dataops-ci-bot]

Integration report for "Reordering schema to match current prod schema, work in progress, not done yet"

sql.diff

Click to expand!

```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql 2024-08-07 14:31:53.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql 2024-08-07 14:31:51.000000000 +0000 @@ -180,6 +180,7 @@ submission_timestamp, client_id, sample_id, + profile_group_id, document_id, metadata.uri.app_update_channel AS channel, normalized_channel, @@ -1503,6 +1504,7 @@ submission_timestamp ASC ) ) AS startup_profile_selection_first_ping_only, + MIN(profile_group_id) AS profile_group_id, SUM( scalar_parent_browser_ui_interaction_textrecognition_error ) AS scalar_parent_browser_ui_interaction_textrecognition_error_sum, @@ -1573,9 +1575,200 @@ aggregates ) SELECT - * EXCEPT (map_sum_aggregates), - -- CAUTION: the order of fields here must match the order defined in - -- map_sum_aggregates above and offsets must increment on each line. + submission_date, + client_id, + aborts_content_sum, + aborts_gmplugin_sum, + aborts_plugin_sum, + active_addons_count_mean, + active_addons, + active_experiment_branch, + active_hours_sum, + addon_compatibility_check_enabled, + app_build_id, + app_display_version, + app_name, + app_version, + attribution, + blocklist_enabled, + channel, + client_clock_skew_mean, + client_submission_latency_mean, + cpu_cores, + cpu_count, + cpu_family, + cpu_l2_cache_kb, + cpu_l3_cache_kb, + cpu_model, + cpu_speed_mhz, + cpu_stepping, + cpu_vendor, + crashes_detected_content_sum, + crashes_detected_gmplugin_sum, + crashes_detected_plugin_sum, + crash_submit_attempt_content_sum, + crash_submit_attempt_main_sum, + crash_submit_attempt_plugin_sum, + crash_submit_success_content_sum, + crash_submit_success_main_sum, + crash_submit_success_plugin_sum, + default_search_engine, + default_search_engine_data_load_path, + default_search_engine_data_name, + default_search_engine_data_origin, + default_search_engine_data_submission_url, + devtools_toolbox_opened_count_sum, + distribution_id, + e10s_enabled, + env_build_arch, + env_build_id, + env_build_version, + environment_settings_intl_accept_languages, + environment_settings_intl_app_locales, + environment_settings_intl_available_locales, + environment_settings_intl_requested_locales, + environment_settings_intl_system_locales, + environment_settings_intl_regional_prefs_locales, + experiments, + first_paint_mean, + flash_version, + country, + city, + geo_subdivision1, + geo_subdivision2, + isp_name, + isp_organization, + gfx_features_advanced_layers_status, + gfx_features_d2d_status, + gfx_features_d3d11_status, + gfx_features_gpu_process_status, + histogram_parent_devtools_aboutdebugging_opened_count_sum, + histogram_parent_devtools_animationinspector_opened_count_sum, + histogram_parent_devtools_browserconsole_opened_count_sum, + histogram_parent_devtools_canvasdebugger_opened_count_sum, + histogram_parent_devtools_computedview_opened_count_sum, + histogram_parent_devtools_custom_opened_count_sum, + histogram_parent_devtools_developertoolbar_opened_count_sum, + histogram_parent_devtools_dom_opened_count_sum, + histogram_parent_devtools_eyedropper_opened_count_sum, + histogram_parent_devtools_fontinspector_opened_count_sum, + histogram_parent_devtools_inspector_opened_count_sum, + histogram_parent_devtools_jsbrowserdebugger_opened_count_sum, + histogram_parent_devtools_jsdebugger_opened_count_sum, + histogram_parent_devtools_jsprofiler_opened_count_sum, + histogram_parent_devtools_layoutview_opened_count_sum, + histogram_parent_devtools_memory_opened_count_sum, + histogram_parent_devtools_menu_eyedropper_opened_count_sum, + histogram_parent_devtools_netmonitor_opened_count_sum, + histogram_parent_devtools_options_opened_count_sum, + histogram_parent_devtools_paintflashing_opened_count_sum, + histogram_parent_devtools_picker_eyedropper_opened_count_sum, + histogram_parent_devtools_responsive_opened_count_sum, + histogram_parent_devtools_ruleview_opened_count_sum, + histogram_parent_devtools_scratchpad_opened_count_sum, + histogram_parent_devtools_scratchpad_window_opened_count_sum, + histogram_parent_devtools_shadereditor_opened_count_sum, + histogram_parent_devtools_storage_opened_count_sum, + histogram_parent_devtools_styleeditor_opened_count_sum, + histogram_parent_devtools_webaudioeditor_opened_count_sum, + histogram_parent_devtools_webconsole_opened_count_sum, + histogram_parent_devtools_webide_opened_count_sum, + install_year, + is_default_browser, + is_wow64, + locale, + memory_mb, + normalized_channel, + normalized_os_version, + os, + os_service_pack_major, + os_service_pack_minor, + os_version, + pings_aggregated_by_this_row, + places_bookmarks_count_mean, + places_pages_count_mean, + plugin_hangs_sum, + plugins_infobar_allow_sum, + plugins_infobar_block_sum, + plugins_infobar_shown_sum, + plugins_notification_shown_sum, + previous_build_id, + profile_age_in_days, + profile_creation_date, + push_api_notify_sum, + sample_id, + sandbox_effective_content_process_level, + scalar_combined_webrtc_nicer_stun_retransmits_sum, + scalar_combined_webrtc_nicer_turn_401s_sum, + scalar_combined_webrtc_nicer_turn_403s_sum, + scalar_combined_webrtc_nicer_turn_438s_sum, + scalar_content_navigator_storage_estimate_count_sum, + scalar_content_navigator_storage_persist_count_sum, + scalar_parent_aushelper_websense_reg_version, + scalar_parent_browser_engagement_max_concurrent_tab_count_max, + scalar_parent_browser_engagement_max_concurrent_window_count_max, + scalar_parent_browser_engagement_tab_open_event_count_sum, + scalar_parent_browser_engagement_total_uri_count_sum, + scalar_parent_browser_engagement_unfiltered_uri_count_sum, + scalar_parent_browser_engagement_unique_domains_count_max, + scalar_parent_browser_engagement_unique_domains_count_mean, + scalar_parent_browser_engagement_window_open_event_count_sum, + scalar_parent_devtools_accessibility_node_inspected_count_sum, + scalar_parent_devtools_accessibility_opened_count_sum, + scalar_parent_devtools_accessibility_picker_used_count_sum, + scalar_parent_devtools_accessibility_select_accessible_for_node_sum, + scalar_parent_devtools_accessibility_service_enabled_count_sum, + scalar_parent_devtools_copy_full_css_selector_opened_sum, + scalar_parent_devtools_copy_unique_css_selector_opened_sum, + scalar_parent_devtools_toolbar_eyedropper_opened_sum, + scalar_parent_dom_contentprocess_troubled_due_to_memory_sum, + scalar_parent_navigator_storage_estimate_count_sum, + scalar_parent_navigator_storage_persist_count_sum, + scalar_parent_storage_sync_api_usage_extensions_using_sum, + search_cohort, + search_count_abouthome, + search_count_contextmenu, + search_count_newtab, + search_count_searchbar, + search_count_system, + search_count_urlbar, + search_count_all, + search_count_tagged_sap, + search_count_tagged_follow_on, + search_count_organic, + search_count_urlbar_handoff, + session_restored_mean, + sessions_started_on_this_day, + shutdown_kill_sum, + subsession_hours_sum, + ssl_handshake_result_failure_sum, + ssl_handshake_result_success_sum, + sync_configured, + sync_count_desktop_mean, + sync_count_mobile_mean, + sync_count_desktop_sum, + sync_count_mobile_sum, + telemetry_enabled, + timezone_offset, + total_hours_sum, + update_auto_download, + update_channel, + update_enabled, + vendor, + web_notification_shown_sum, + windows_build_number, + windows_ubr, + fxa_configured, + trackers_blocked_sum, + submission_timestamp_min, + ad_clicks_count_all, + search_with_ads_count_all, + scalar_parent_urlbar_impression_autofill_about_sum, + scalar_parent_urlbar_impression_autofill_adaptive_sum, + scalar_parent_urlbar_impression_autofill_origin_sum, + scalar_parent_urlbar_impression_autofill_other_sum, + scalar_parent_urlbar_impression_autofill_preloaded_sum, + scalar_parent_urlbar_impression_autofill_url_sum, map_sum_aggregates[OFFSET(0)].map AS scalar_parent_telemetry_event_counts_sum, map_sum_aggregates[OFFSET(1)].map AS scalar_content_telemetry_event_counts_sum, map_sum_aggregates[OFFSET(2)].map AS scalar_parent_urlbar_searchmode_bookmarkmenu_sum, @@ -1591,6 +1784,15 @@ map_sum_aggregates[OFFSET(12)].map AS scalar_parent_urlbar_searchmode_topsites_urlbar_sum, map_sum_aggregates[OFFSET(13)].map AS scalar_parent_urlbar_searchmode_touchbar_sum, map_sum_aggregates[OFFSET(14)].map AS scalar_parent_urlbar_searchmode_typed_sum, + scalar_parent_os_environment_is_taskbar_pinned, + scalar_parent_os_environment_launched_via_desktop, + scalar_parent_os_environment_launched_via_taskbar, + scalar_parent_os_environment_launched_via_other, + scalar_parent_os_environment_launched_via_start_menu, + scalar_parent_os_environment_launched_via_other_shortcut, + search_count_webextension, + search_count_alias, + search_count_urlbar_searchmode, map_sum_aggregates[ OFFSET(15) ].map AS scalar_parent_browser_ui_interaction_preferences_pane_home_sum, @@ -1616,9 +1818,17 @@ map_sum_aggregates[OFFSET(35)].map AS scalar_parent_urlbar_picked_topsite_sum, map_sum_aggregates[OFFSET(36)].map AS scalar_parent_urlbar_picked_unknown_sum, map_sum_aggregates[OFFSET(37)].map AS scalar_parent_urlbar_picked_visiturl_sum, + default_private_search_engine, + default_private_search_engine_data_load_path, + default_private_search_engine_data_name, + default_private_search_engine_data_origin, + default_private_search_engine_data_submission_url, + search_counts, + user_pref_browser_search_region, map_sum_aggregates[OFFSET(38)].map AS search_with_ads, map_sum_aggregates[OFFSET(39)].map AS ad_clicks, map_sum_aggregates[OFFSET(40)].map AS search_content_urlbar_sum, + map_sum_aggregates[OFFSET(73)].map AS search_content_urlbar_handoff_sum, map_sum_aggregates[OFFSET(41)].map AS search_content_urlbar_searchmode_sum, map_sum_aggregates[OFFSET(42)].map AS search_content_contextmenu_sum, map_sum_aggregates[OFFSET(43)].map AS search_content_about_home_sum, @@ -1630,6 +1840,7 @@ map_sum_aggregates[OFFSET(49)].map AS search_content_reload_sum, map_sum_aggregates[OFFSET(50)].map AS search_content_unknown_sum, map_sum_aggregates[OFFSET(51)].map AS search_withads_urlbar_sum, + map_sum_aggregates[OFFSET(74)].map AS search_withads_urlbar_handoff_sum, map_sum_aggregates[OFFSET(52)].map AS search_withads_urlbar_searchmode_sum, map_sum_aggregates[OFFSET(53)].map AS search_withads_contextmenu_sum, map_sum_aggregates[OFFSET(54)].map AS search_withads_about_home_sum, @@ -1641,6 +1852,7 @@ map_sum_aggregates[OFFSET(60)].map AS search_withads_reload_sum, map_sum_aggregates[OFFSET(61)].map AS search_withads_unknown_sum, map_sum_aggregates[OFFSET(62)].map AS search_adclicks_urlbar_sum, + map_sum_aggregates[OFFSET(75)].map AS search_adclicks_urlbar_handoff_sum, map_sum_aggregates[OFFSET(63)].map AS search_adclicks_urlbar_searchmode_sum, map_sum_aggregates[OFFSET(64)].map AS search_adclicks_contextmenu_sum, map_sum_aggregates[OFFSET(65)].map AS search_adclicks_about_home_sum, @@ -1651,71 +1863,132 @@ map_sum_aggregates[OFFSET(70)].map AS search_adclicks_tabhistory_sum, map_sum_aggregates[OFFSET(71)].map AS search_adclicks_reload_sum, map_sum_aggregates[OFFSET(72)].map AS search_adclicks_unknown_sum, - map_sum_aggregates[OFFSET(73)].map AS search_content_urlbar_handoff_sum, - map_sum_aggregates[OFFSET(74)].map AS search_withads_urlbar_handoff_sum, - map_sum_aggregates[OFFSET(75)].map AS search_adclicks_urlbar_handoff_sum, + update_background, + user_pref_browser_search_suggest_enabled, + user_pref_browser_widget_in_navbar, + user_pref_browser_urlbar_suggest_searches, + user_pref_browser_urlbar_show_search_suggestions_first, + user_pref_browser_urlbar_suggest_quicksuggest, + user_pref_browser_urlbar_suggest_quicksuggest_sponsored, + user_pref_browser_urlbar_quicksuggest_onboarding_dialog_choice, + scalar_parent_browser_engagement_total_uri_count_normal_and_private_mode_sum, + user_pref_browser_newtabpage_enabled, + user_pref_app_shield_optoutstudies_enabled, + map_sum_aggregates[OFFSET(82)].map AS contextual_services_quicksuggest_click_sum, + map_sum_aggregates[OFFSET(96)].map AS contextual_services_quicksuggest_impression_sum, + map_sum_aggregates[OFFSET(89)].map AS contextual_services_quicksuggest_help_sum, + map_sum_aggregates[OFFSET(103)].map AS contextual_services_topsites_click_sum, + map_sum_aggregates[OFFSET(104)].map AS contextual_services_topsites_impression_sum, + user_pref_browser_urlbar_suggest_quicksuggest_nonsponsored, + user_pref_browser_urlbar_quicksuggest_data_collection_enabled, + scalar_a11y_hcm_foreground, + scalar_a11y_hcm_background, + a11y_theme, map_sum_aggregates[ - OFFSET(76) - ].map AS contextual_services_quicksuggest_block_dynamic_wikipedia_sum, - map_sum_aggregates[OFFSET(77)].map AS contextual_services_quicksuggest_block_nonsponsored_sum, + OFFSET(92) + ].map AS contextual_services_quicksuggest_help_nonsponsored_bestmatch_sum, map_sum_aggregates[ - OFFSET(78) - ].map AS contextual_services_quicksuggest_block_nonsponsored_bestmatch_sum, + OFFSET(94) + ].map AS contextual_services_quicksuggest_help_sponsored_bestmatch_sum, + map_sum_aggregates[OFFSET(77)].map AS contextual_services_quicksuggest_block_nonsponsored_sum, map_sum_aggregates[OFFSET(79)].map AS contextual_services_quicksuggest_block_sponsored_sum, map_sum_aggregates[ OFFSET(80) ].map AS contextual_services_quicksuggest_block_sponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(78) + ].map AS contextual_services_quicksuggest_block_nonsponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(87) + ].map AS contextual_services_quicksuggest_click_sponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(85) + ].map AS contextual_services_quicksuggest_click_nonsponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(101) + ].map AS contextual_services_quicksuggest_impression_sponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(99) + ].map AS contextual_services_quicksuggest_impression_nonsponsored_bestmatch_sum, + user_pref_browser_urlbar_suggest_bestmatch, + scalar_parent_browser_ui_interaction_textrecognition_error_sum, + text_recognition_interaction_timing_sum, + text_recognition_interaction_timing_count_sum, + map_sum_aggregates[OFFSET(105)].map AS scalar_parent_browser_ui_interaction_content_context_sum, + text_recognition_api_performance_sum, + text_recognition_api_performance_count_sum, + text_recognition_text_length_sum, + text_recognition_text_length_count_sum, + scalar_parent_os_environment_launched_via_taskbar_private, + dom_parentprocess_private_window_used, + os_environment_is_taskbar_pinned_any, + os_environment_is_taskbar_pinned_private_any, + os_environment_is_taskbar_pinned_private, + bookmark_migrations_quantity_chrome, + bookmark_migrations_quantity_edge, + bookmark_migrations_quantity_safari, + bookmark_migrations_quantity_all, + history_migrations_quantity_chrome, + history_migrations_quantity_edge, + history_migrations_quantity_safari, + history_migrations_quantity_all, + logins_migrations_quantity_chrome, + logins_migrations_quantity_edge, + logins_migrations_quantity_safari, + logins_migrations_quantity_all, + search_count_urlbar_persisted, + map_sum_aggregates[OFFSET(106)].map AS search_content_urlbar_persisted_sum, + map_sum_aggregates[OFFSET(107)].map AS search_withads_urlbar_persisted_sum, + map_sum_aggregates[OFFSET(108)].map AS search_adclicks_urlbar_persisted_sum, + media_play_time_ms_audio_sum, + media_play_time_ms_video_sum, + map_sum_aggregates[ + OFFSET(76) + ].map AS contextual_services_quicksuggest_block_dynamic_wikipedia_sum, map_sum_aggregates[OFFSET(81)].map AS contextual_services_quicksuggest_block_weather_sum, - map_sum_aggregates[OFFSET(82)].map AS contextual_services_quicksuggest_click_sum, map_sum_aggregates[ OFFSET(83) ].map AS contextual_services_quicksuggest_click_dynamic_wikipedia_sum, map_sum_aggregates[OFFSET(84)].map AS contextual_services_quicksuggest_click_nonsponsored_sum, - map_sum_aggregates[ - OFFSET(85) - ].map AS contextual_services_quicksuggest_click_nonsponsored_bestmatch_sum, map_sum_aggregates[OFFSET(86)].map AS contextual_services_quicksuggest_click_sponsored_sum, - map_sum_aggregates[ - OFFSET(87) - ].map AS contextual_services_quicksuggest_click_sponsored_bestmatch_sum, map_sum_aggregates[OFFSET(88)].map AS contextual_services_quicksuggest_click_weather_sum, - map_sum_aggregates[OFFSET(89)].map AS contextual_services_quicksuggest_help_sum, map_sum_aggregates[OFFSET(90)].map AS contextual_services_quicksuggest_help_dynamic_wikipedia_sum, map_sum_aggregates[OFFSET(91)].map AS contextual_services_quicksuggest_help_nonsponsored_sum, - map_sum_aggregates[ - OFFSET(92) - ].map AS contextual_services_quicksuggest_help_nonsponsored_bestmatch_sum, map_sum_aggregates[OFFSET(93)].map AS contextual_services_quicksuggest_help_sponsored_sum, - map_sum_aggregates[ - OFFSET(94) - ].map AS contextual_services_quicksuggest_help_sponsored_bestmatch_sum, map_sum_aggregates[OFFSET(95)].map AS contextual_services_quicksuggest_help_weather_sum, - map_sum_aggregates[OFFSET(96)].map AS contextual_services_quicksuggest_impression_sum, map_sum_aggregates[ OFFSET(97) ].map AS contextual_services_quicksuggest_impression_dynamic_wikipedia_sum, map_sum_aggregates[ OFFSET(98) ].map AS contextual_services_quicksuggest_impression_nonsponsored_sum, - map_sum_aggregates[ - OFFSET(99) - ].map AS contextual_services_quicksuggest_impression_nonsponsored_bestmatch_sum, map_sum_aggregates[OFFSET(100)].map AS contextual_services_quicksuggest_impression_sponsored_sum, - map_sum_aggregates[ - OFFSET(101) - ].map AS contextual_services_quicksuggest_impression_sponsored_bestmatch_sum, map_sum_aggregates[OFFSET(102)].map AS contextual_services_quicksuggest_impression_weather_sum, - map_sum_aggregates[OFFSET(103)].map AS contextual_services_topsites_click_sum, - map_sum_aggregates[OFFSET(104)].map AS contextual_services_topsites_impression_sum, - map_sum_aggregates[OFFSET(105)].map AS scalar_parent_browser_ui_interaction_content_context_sum, - map_sum_aggregates[OFFSET(106)].map AS search_content_urlbar_persisted_sum, - map_sum_aggregates[OFFSET(107)].map AS search_withads_urlbar_persisted_sum, - map_sum_aggregates[OFFSET(108)].map AS search_adclicks_urlbar_persisted_sum, + places_searchbar_cumulative_searches_sum, + places_searchbar_cumulative_filter_count_sum, map_sum_aggregates[OFFSET(109)].map AS scalar_parent_sidebar_opened_sum, map_sum_aggregates[OFFSET(110)].map AS scalar_parent_sidebar_search_sum, map_sum_aggregates[OFFSET(111)].map AS scalar_parent_sidebar_link_sum, + places_previousday_visits_mean, + places_library_cumulative_bookmark_searches_sum, + places_library_cumulative_history_searches_sum, + places_bookmarks_searchbar_cumulative_searches_sum, map_sum_aggregates[OFFSET(112)].map AS scalar_parent_library_link_sum, map_sum_aggregates[OFFSET(113)].map AS scalar_parent_library_opened_sum, map_sum_aggregates[OFFSET(114)].map AS scalar_parent_library_search_sum, + startup_profile_selection_reason_first, + first_document_id, + partner_id, + distribution_version, + distributor, + distributor_channel, + env_build_platform_version, + env_build_xpcom_abi, + geo_db_version, + apple_model_id, + max_subsession_counter, + min_subsession_counter, + startup_profile_selection_first_ping_only, + profile_group_id FROM udf_aggregates diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml 2024-08-07 14:31:53.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml 2024-08-07 14:31:51.000000000 +0000 @@ -765,9 +765,6 @@ - mode: NULLABLE name: search_count_urlbar_handoff type: INTEGER -- mode: NULLABLE - name: search_count_urlbar_persisted - type: INTEGER - description: null mode: NULLABLE name: session_restored_mean @@ -2074,6 +2071,9 @@ name: history_migrations_quantity_all type: INTEGER - mode: NULLABLE + name: search_count_urlbar_persisted + type: INTEGER +- mode: NULLABLE name: logins_migrations_quantity_chrome type: INTEGER - mode: NULLABLE @@ -2342,3 +2342,7 @@ - name: startup_profile_selection_first_ping_only type: STRING mode: NULLABLE +- name: profile_group_id + type: STRING + mode: NULLABLE + description: A UUID identifying the profile's group on a single device and allowing user-oriented correlation of data ```

Link to full diff

[dataops-ci-bot]

Integration report for "DENG-4446 reordering cols to match prod, still a work in progress, not done yet"

sql.diff

Click to expand!

```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql 2024-08-07 15:06:08.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql 2024-08-07 15:06:33.000000000 +0000 @@ -180,6 +180,7 @@ submission_timestamp, client_id, sample_id, + profile_group_id, document_id, metadata.uri.app_update_channel AS channel, normalized_channel, @@ -1503,6 +1504,7 @@ submission_timestamp ASC ) ) AS startup_profile_selection_first_ping_only, + MIN(profile_group_id) AS profile_group_id, SUM( scalar_parent_browser_ui_interaction_textrecognition_error ) AS scalar_parent_browser_ui_interaction_textrecognition_error_sum, @@ -1573,9 +1575,200 @@ aggregates ) SELECT - * EXCEPT (map_sum_aggregates), - -- CAUTION: the order of fields here must match the order defined in - -- map_sum_aggregates above and offsets must increment on each line. + submission_date, + client_id, + aborts_content_sum, + aborts_gmplugin_sum, + aborts_plugin_sum, + active_addons_count_mean, + active_addons, + active_experiment_branch, + active_hours_sum, + addon_compatibility_check_enabled, + app_build_id, + app_display_version, + app_name, + app_version, + attribution, + blocklist_enabled, + channel, + client_clock_skew_mean, + client_submission_latency_mean, + cpu_cores, + cpu_count, + cpu_family, + cpu_l2_cache_kb, + cpu_l3_cache_kb, + cpu_model, + cpu_speed_mhz, + cpu_stepping, + cpu_vendor, + crashes_detected_content_sum, + crashes_detected_gmplugin_sum, + crashes_detected_plugin_sum, + crash_submit_attempt_content_sum, + crash_submit_attempt_main_sum, + crash_submit_attempt_plugin_sum, + crash_submit_success_content_sum, + crash_submit_success_main_sum, + crash_submit_success_plugin_sum, + default_search_engine, + default_search_engine_data_load_path, + default_search_engine_data_name, + default_search_engine_data_origin, + default_search_engine_data_submission_url, + devtools_toolbox_opened_count_sum, + distribution_id, + e10s_enabled, + env_build_arch, + env_build_id, + env_build_version, + environment_settings_intl_accept_languages, + environment_settings_intl_app_locales, + environment_settings_intl_available_locales, + environment_settings_intl_requested_locales, + environment_settings_intl_system_locales, + environment_settings_intl_regional_prefs_locales, + experiments, + first_paint_mean, + flash_version, + country, + city, + geo_subdivision1, + geo_subdivision2, + isp_name, + isp_organization, + gfx_features_advanced_layers_status, + gfx_features_d2d_status, + gfx_features_d3d11_status, + gfx_features_gpu_process_status, + histogram_parent_devtools_aboutdebugging_opened_count_sum, + histogram_parent_devtools_animationinspector_opened_count_sum, + histogram_parent_devtools_browserconsole_opened_count_sum, + histogram_parent_devtools_canvasdebugger_opened_count_sum, + histogram_parent_devtools_computedview_opened_count_sum, + histogram_parent_devtools_custom_opened_count_sum, + histogram_parent_devtools_developertoolbar_opened_count_sum, + histogram_parent_devtools_dom_opened_count_sum, + histogram_parent_devtools_eyedropper_opened_count_sum, + histogram_parent_devtools_fontinspector_opened_count_sum, + histogram_parent_devtools_inspector_opened_count_sum, + histogram_parent_devtools_jsbrowserdebugger_opened_count_sum, + histogram_parent_devtools_jsdebugger_opened_count_sum, + histogram_parent_devtools_jsprofiler_opened_count_sum, + histogram_parent_devtools_layoutview_opened_count_sum, + histogram_parent_devtools_memory_opened_count_sum, + histogram_parent_devtools_menu_eyedropper_opened_count_sum, + histogram_parent_devtools_netmonitor_opened_count_sum, + histogram_parent_devtools_options_opened_count_sum, + histogram_parent_devtools_paintflashing_opened_count_sum, + histogram_parent_devtools_picker_eyedropper_opened_count_sum, + histogram_parent_devtools_responsive_opened_count_sum, + histogram_parent_devtools_ruleview_opened_count_sum, + histogram_parent_devtools_scratchpad_opened_count_sum, + histogram_parent_devtools_scratchpad_window_opened_count_sum, + histogram_parent_devtools_shadereditor_opened_count_sum, + histogram_parent_devtools_storage_opened_count_sum, + histogram_parent_devtools_styleeditor_opened_count_sum, + histogram_parent_devtools_webaudioeditor_opened_count_sum, + histogram_parent_devtools_webconsole_opened_count_sum, + histogram_parent_devtools_webide_opened_count_sum, + install_year, + is_default_browser, + is_wow64, + locale, + memory_mb, + normalized_channel, + normalized_os_version, + os, + os_service_pack_major, + os_service_pack_minor, + os_version, + pings_aggregated_by_this_row, + places_bookmarks_count_mean, + places_pages_count_mean, + plugin_hangs_sum, + plugins_infobar_allow_sum, + plugins_infobar_block_sum, + plugins_infobar_shown_sum, + plugins_notification_shown_sum, + previous_build_id, + profile_age_in_days, + profile_creation_date, + push_api_notify_sum, + sample_id, + sandbox_effective_content_process_level, + scalar_combined_webrtc_nicer_stun_retransmits_sum, + scalar_combined_webrtc_nicer_turn_401s_sum, + scalar_combined_webrtc_nicer_turn_403s_sum, + scalar_combined_webrtc_nicer_turn_438s_sum, + scalar_content_navigator_storage_estimate_count_sum, + scalar_content_navigator_storage_persist_count_sum, + scalar_parent_aushelper_websense_reg_version, + scalar_parent_browser_engagement_max_concurrent_tab_count_max, + scalar_parent_browser_engagement_max_concurrent_window_count_max, + scalar_parent_browser_engagement_tab_open_event_count_sum, + scalar_parent_browser_engagement_total_uri_count_sum, + scalar_parent_browser_engagement_unfiltered_uri_count_sum, + scalar_parent_browser_engagement_unique_domains_count_max, + scalar_parent_browser_engagement_unique_domains_count_mean, + scalar_parent_browser_engagement_window_open_event_count_sum, + scalar_parent_devtools_accessibility_node_inspected_count_sum, + scalar_parent_devtools_accessibility_opened_count_sum, + scalar_parent_devtools_accessibility_picker_used_count_sum, + scalar_parent_devtools_accessibility_select_accessible_for_node_sum, + scalar_parent_devtools_accessibility_service_enabled_count_sum, + scalar_parent_devtools_copy_full_css_selector_opened_sum, + scalar_parent_devtools_copy_unique_css_selector_opened_sum, + scalar_parent_devtools_toolbar_eyedropper_opened_sum, + scalar_parent_dom_contentprocess_troubled_due_to_memory_sum, + scalar_parent_navigator_storage_estimate_count_sum, + scalar_parent_navigator_storage_persist_count_sum, + scalar_parent_storage_sync_api_usage_extensions_using_sum, + search_cohort, + search_count_abouthome, + search_count_contextmenu, + search_count_newtab, + search_count_searchbar, + search_count_system, + search_count_urlbar, + search_count_all, + search_count_tagged_sap, + search_count_tagged_follow_on, + search_count_organic, + search_count_urlbar_handoff, + session_restored_mean, + sessions_started_on_this_day, + shutdown_kill_sum, + subsession_hours_sum, + ssl_handshake_result_failure_sum, + ssl_handshake_result_success_sum, + sync_configured, + sync_count_desktop_mean, + sync_count_mobile_mean, + sync_count_desktop_sum, + sync_count_mobile_sum, + telemetry_enabled, + timezone_offset, + total_hours_sum, + update_auto_download, + update_channel, + update_enabled, + vendor, + web_notification_shown_sum, + windows_build_number, + windows_ubr, + fxa_configured, + trackers_blocked_sum, + submission_timestamp_min, + ad_clicks_count_all, + search_with_ads_count_all, + scalar_parent_urlbar_impression_autofill_about_sum, + scalar_parent_urlbar_impression_autofill_adaptive_sum, + scalar_parent_urlbar_impression_autofill_origin_sum, + scalar_parent_urlbar_impression_autofill_other_sum, + scalar_parent_urlbar_impression_autofill_preloaded_sum, + scalar_parent_urlbar_impression_autofill_url_sum, map_sum_aggregates[OFFSET(0)].map AS scalar_parent_telemetry_event_counts_sum, map_sum_aggregates[OFFSET(1)].map AS scalar_content_telemetry_event_counts_sum, map_sum_aggregates[OFFSET(2)].map AS scalar_parent_urlbar_searchmode_bookmarkmenu_sum, @@ -1591,6 +1784,15 @@ map_sum_aggregates[OFFSET(12)].map AS scalar_parent_urlbar_searchmode_topsites_urlbar_sum, map_sum_aggregates[OFFSET(13)].map AS scalar_parent_urlbar_searchmode_touchbar_sum, map_sum_aggregates[OFFSET(14)].map AS scalar_parent_urlbar_searchmode_typed_sum, + scalar_parent_os_environment_is_taskbar_pinned, + scalar_parent_os_environment_launched_via_desktop, + scalar_parent_os_environment_launched_via_taskbar, + scalar_parent_os_environment_launched_via_other, + scalar_parent_os_environment_launched_via_start_menu, + scalar_parent_os_environment_launched_via_other_shortcut, + search_count_webextension, + search_count_alias, + search_count_urlbar_searchmode, map_sum_aggregates[ OFFSET(15) ].map AS scalar_parent_browser_ui_interaction_preferences_pane_home_sum, @@ -1616,9 +1818,17 @@ map_sum_aggregates[OFFSET(35)].map AS scalar_parent_urlbar_picked_topsite_sum, map_sum_aggregates[OFFSET(36)].map AS scalar_parent_urlbar_picked_unknown_sum, map_sum_aggregates[OFFSET(37)].map AS scalar_parent_urlbar_picked_visiturl_sum, + default_private_search_engine, + default_private_search_engine_data_load_path, + default_private_search_engine_data_name, + default_private_search_engine_data_origin, + default_private_search_engine_data_submission_url, + search_counts, + user_pref_browser_search_region, map_sum_aggregates[OFFSET(38)].map AS search_with_ads, map_sum_aggregates[OFFSET(39)].map AS ad_clicks, map_sum_aggregates[OFFSET(40)].map AS search_content_urlbar_sum, + map_sum_aggregates[OFFSET(73)].map AS search_content_urlbar_handoff_sum, map_sum_aggregates[OFFSET(41)].map AS search_content_urlbar_searchmode_sum, map_sum_aggregates[OFFSET(42)].map AS search_content_contextmenu_sum, map_sum_aggregates[OFFSET(43)].map AS search_content_about_home_sum, @@ -1630,6 +1840,7 @@ map_sum_aggregates[OFFSET(49)].map AS search_content_reload_sum, map_sum_aggregates[OFFSET(50)].map AS search_content_unknown_sum, map_sum_aggregates[OFFSET(51)].map AS search_withads_urlbar_sum, + map_sum_aggregates[OFFSET(74)].map AS search_withads_urlbar_handoff_sum, map_sum_aggregates[OFFSET(52)].map AS search_withads_urlbar_searchmode_sum, map_sum_aggregates[OFFSET(53)].map AS search_withads_contextmenu_sum, map_sum_aggregates[OFFSET(54)].map AS search_withads_about_home_sum, @@ -1641,6 +1852,7 @@ map_sum_aggregates[OFFSET(60)].map AS search_withads_reload_sum, map_sum_aggregates[OFFSET(61)].map AS search_withads_unknown_sum, map_sum_aggregates[OFFSET(62)].map AS search_adclicks_urlbar_sum, + map_sum_aggregates[OFFSET(75)].map AS search_adclicks_urlbar_handoff_sum, map_sum_aggregates[OFFSET(63)].map AS search_adclicks_urlbar_searchmode_sum, map_sum_aggregates[OFFSET(64)].map AS search_adclicks_contextmenu_sum, map_sum_aggregates[OFFSET(65)].map AS search_adclicks_about_home_sum, @@ -1651,71 +1863,132 @@ map_sum_aggregates[OFFSET(70)].map AS search_adclicks_tabhistory_sum, map_sum_aggregates[OFFSET(71)].map AS search_adclicks_reload_sum, map_sum_aggregates[OFFSET(72)].map AS search_adclicks_unknown_sum, - map_sum_aggregates[OFFSET(73)].map AS search_content_urlbar_handoff_sum, - map_sum_aggregates[OFFSET(74)].map AS search_withads_urlbar_handoff_sum, - map_sum_aggregates[OFFSET(75)].map AS search_adclicks_urlbar_handoff_sum, + update_background, + user_pref_browser_search_suggest_enabled, + user_pref_browser_widget_in_navbar, + user_pref_browser_urlbar_suggest_searches, + user_pref_browser_urlbar_show_search_suggestions_first, + user_pref_browser_urlbar_suggest_quicksuggest, + user_pref_browser_urlbar_suggest_quicksuggest_sponsored, + user_pref_browser_urlbar_quicksuggest_onboarding_dialog_choice, + scalar_parent_browser_engagement_total_uri_count_normal_and_private_mode_sum, + user_pref_browser_newtabpage_enabled, + user_pref_app_shield_optoutstudies_enabled, + map_sum_aggregates[OFFSET(82)].map AS contextual_services_quicksuggest_click_sum, + map_sum_aggregates[OFFSET(96)].map AS contextual_services_quicksuggest_impression_sum, + map_sum_aggregates[OFFSET(89)].map AS contextual_services_quicksuggest_help_sum, + map_sum_aggregates[OFFSET(103)].map AS contextual_services_topsites_click_sum, + map_sum_aggregates[OFFSET(104)].map AS contextual_services_topsites_impression_sum, + user_pref_browser_urlbar_suggest_quicksuggest_nonsponsored, + user_pref_browser_urlbar_quicksuggest_data_collection_enabled, + scalar_a11y_hcm_foreground, + scalar_a11y_hcm_background, + a11y_theme, map_sum_aggregates[ - OFFSET(76) - ].map AS contextual_services_quicksuggest_block_dynamic_wikipedia_sum, - map_sum_aggregates[OFFSET(77)].map AS contextual_services_quicksuggest_block_nonsponsored_sum, + OFFSET(92) + ].map AS contextual_services_quicksuggest_help_nonsponsored_bestmatch_sum, map_sum_aggregates[ - OFFSET(78) - ].map AS contextual_services_quicksuggest_block_nonsponsored_bestmatch_sum, + OFFSET(94) + ].map AS contextual_services_quicksuggest_help_sponsored_bestmatch_sum, + map_sum_aggregates[OFFSET(77)].map AS contextual_services_quicksuggest_block_nonsponsored_sum, map_sum_aggregates[OFFSET(79)].map AS contextual_services_quicksuggest_block_sponsored_sum, map_sum_aggregates[ OFFSET(80) ].map AS contextual_services_quicksuggest_block_sponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(78) + ].map AS contextual_services_quicksuggest_block_nonsponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(87) + ].map AS contextual_services_quicksuggest_click_sponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(85) + ].map AS contextual_services_quicksuggest_click_nonsponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(101) + ].map AS contextual_services_quicksuggest_impression_sponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(99) + ].map AS contextual_services_quicksuggest_impression_nonsponsored_bestmatch_sum, + user_pref_browser_urlbar_suggest_bestmatch, + scalar_parent_browser_ui_interaction_textrecognition_error_sum, + text_recognition_interaction_timing_sum, + text_recognition_interaction_timing_count_sum, + map_sum_aggregates[OFFSET(105)].map AS scalar_parent_browser_ui_interaction_content_context_sum, + text_recognition_api_performance_sum, + text_recognition_api_performance_count_sum, + text_recognition_text_length_sum, + text_recognition_text_length_count_sum, + scalar_parent_os_environment_launched_via_taskbar_private, + dom_parentprocess_private_window_used, + os_environment_is_taskbar_pinned_any, + os_environment_is_taskbar_pinned_private_any, + os_environment_is_taskbar_pinned_private, + bookmark_migrations_quantity_chrome, + bookmark_migrations_quantity_edge, + bookmark_migrations_quantity_safari, + bookmark_migrations_quantity_all, + history_migrations_quantity_chrome, + history_migrations_quantity_edge, + history_migrations_quantity_safari, + history_migrations_quantity_all, + logins_migrations_quantity_chrome, + logins_migrations_quantity_edge, + logins_migrations_quantity_safari, + logins_migrations_quantity_all, + search_count_urlbar_persisted, + map_sum_aggregates[OFFSET(106)].map AS search_content_urlbar_persisted_sum, + map_sum_aggregates[OFFSET(107)].map AS search_withads_urlbar_persisted_sum, + map_sum_aggregates[OFFSET(108)].map AS search_adclicks_urlbar_persisted_sum, + media_play_time_ms_audio_sum, + media_play_time_ms_video_sum, + map_sum_aggregates[ + OFFSET(76) + ].map AS contextual_services_quicksuggest_block_dynamic_wikipedia_sum, map_sum_aggregates[OFFSET(81)].map AS contextual_services_quicksuggest_block_weather_sum, - map_sum_aggregates[OFFSET(82)].map AS contextual_services_quicksuggest_click_sum, map_sum_aggregates[ OFFSET(83) ].map AS contextual_services_quicksuggest_click_dynamic_wikipedia_sum, map_sum_aggregates[OFFSET(84)].map AS contextual_services_quicksuggest_click_nonsponsored_sum, - map_sum_aggregates[ - OFFSET(85) - ].map AS contextual_services_quicksuggest_click_nonsponsored_bestmatch_sum, map_sum_aggregates[OFFSET(86)].map AS contextual_services_quicksuggest_click_sponsored_sum, - map_sum_aggregates[ - OFFSET(87) - ].map AS contextual_services_quicksuggest_click_sponsored_bestmatch_sum, map_sum_aggregates[OFFSET(88)].map AS contextual_services_quicksuggest_click_weather_sum, - map_sum_aggregates[OFFSET(89)].map AS contextual_services_quicksuggest_help_sum, map_sum_aggregates[OFFSET(90)].map AS contextual_services_quicksuggest_help_dynamic_wikipedia_sum, map_sum_aggregates[OFFSET(91)].map AS contextual_services_quicksuggest_help_nonsponsored_sum, - map_sum_aggregates[ - OFFSET(92) - ].map AS contextual_services_quicksuggest_help_nonsponsored_bestmatch_sum, map_sum_aggregates[OFFSET(93)].map AS contextual_services_quicksuggest_help_sponsored_sum, - map_sum_aggregates[ - OFFSET(94) - ].map AS contextual_services_quicksuggest_help_sponsored_bestmatch_sum, map_sum_aggregates[OFFSET(95)].map AS contextual_services_quicksuggest_help_weather_sum, - map_sum_aggregates[OFFSET(96)].map AS contextual_services_quicksuggest_impression_sum, map_sum_aggregates[ OFFSET(97) ].map AS contextual_services_quicksuggest_impression_dynamic_wikipedia_sum, map_sum_aggregates[ OFFSET(98) ].map AS contextual_services_quicksuggest_impression_nonsponsored_sum, - map_sum_aggregates[ - OFFSET(99) - ].map AS contextual_services_quicksuggest_impression_nonsponsored_bestmatch_sum, map_sum_aggregates[OFFSET(100)].map AS contextual_services_quicksuggest_impression_sponsored_sum, - map_sum_aggregates[ - OFFSET(101) - ].map AS contextual_services_quicksuggest_impression_sponsored_bestmatch_sum, map_sum_aggregates[OFFSET(102)].map AS contextual_services_quicksuggest_impression_weather_sum, - map_sum_aggregates[OFFSET(103)].map AS contextual_services_topsites_click_sum, - map_sum_aggregates[OFFSET(104)].map AS contextual_services_topsites_impression_sum, - map_sum_aggregates[OFFSET(105)].map AS scalar_parent_browser_ui_interaction_content_context_sum, - map_sum_aggregates[OFFSET(106)].map AS search_content_urlbar_persisted_sum, - map_sum_aggregates[OFFSET(107)].map AS search_withads_urlbar_persisted_sum, - map_sum_aggregates[OFFSET(108)].map AS search_adclicks_urlbar_persisted_sum, + places_searchbar_cumulative_searches_sum, + places_searchbar_cumulative_filter_count_sum, map_sum_aggregates[OFFSET(109)].map AS scalar_parent_sidebar_opened_sum, map_sum_aggregates[OFFSET(110)].map AS scalar_parent_sidebar_search_sum, map_sum_aggregates[OFFSET(111)].map AS scalar_parent_sidebar_link_sum, + places_previousday_visits_mean, + places_library_cumulative_bookmark_searches_sum, + places_library_cumulative_history_searches_sum, + places_bookmarks_searchbar_cumulative_searches_sum, map_sum_aggregates[OFFSET(112)].map AS scalar_parent_library_link_sum, map_sum_aggregates[OFFSET(113)].map AS scalar_parent_library_opened_sum, map_sum_aggregates[OFFSET(114)].map AS scalar_parent_library_search_sum, + startup_profile_selection_reason_first, + first_document_id, + partner_id, + distribution_version, + distributor, + distributor_channel, + env_build_platform_version, + env_build_xpcom_abi, + geo_db_version, + apple_model_id, + max_subsession_counter, + min_subsession_counter, + startup_profile_selection_first_ping_only, + profile_group_id FROM udf_aggregates diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml 2024-08-07 15:06:08.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml 2024-08-07 15:06:33.000000000 +0000 @@ -765,9 +765,6 @@ - mode: NULLABLE name: search_count_urlbar_handoff type: INTEGER -- mode: NULLABLE - name: search_count_urlbar_persisted - type: INTEGER - description: null mode: NULLABLE name: session_restored_mean @@ -1427,16 +1424,6 @@ name: value type: INTEGER mode: REPEATED - name: search_content_urlbar_persisted_sum - type: RECORD -- fields: - - mode: NULLABLE - name: key - type: STRING - - mode: NULLABLE - name: value - type: INTEGER - mode: REPEATED name: search_content_urlbar_searchmode_sum type: RECORD - fields: @@ -1557,16 +1544,6 @@ name: value type: INTEGER mode: REPEATED - name: search_withads_urlbar_persisted_sum - type: RECORD -- fields: - - mode: NULLABLE - name: key - type: STRING - - mode: NULLABLE - name: value - type: INTEGER - mode: REPEATED name: search_withads_urlbar_searchmode_sum type: RECORD - fields: @@ -2074,6 +2051,29 @@ name: history_migrations_quantity_all type: INTEGER - mode: NULLABLE + name: search_count_urlbar_persisted + type: INTEGER +- fields: + - mode: NULLABLE + name: key + type: STRING + - mode: NULLABLE + name: value + type: INTEGER + mode: REPEATED + name: search_content_urlbar_persisted_sum + type: RECORD +- fields: + - mode: NULLABLE + name: key + type: STRING + - mode: NULLABLE + name: value + type: INTEGER + mode: REPEATED + name: search_withads_urlbar_persisted_sum + type: RECORD +- mode: NULLABLE name: logins_migrations_quantity_chrome type: INTEGER - mode: NULLABLE @@ -2342,3 +2342,7 @@ - name: startup_profile_selection_first_ping_only type: STRING mode: NULLABLE +- name: profile_group_id + type: STRING + mode: NULLABLE + description: A UUID identifying the profile's group on a single device and allowing user-oriented correlation of data ```

Link to full diff

[dataops-ci-bot]

Integration report for "DENG-4446 fixing order to match prod, wip, not done yet"

sql.diff

Click to expand!

```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql 2024-08-07 15:34:10.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql 2024-08-07 15:34:11.000000000 +0000 @@ -180,6 +180,7 @@ submission_timestamp, client_id, sample_id, + profile_group_id, document_id, metadata.uri.app_update_channel AS channel, normalized_channel, @@ -1503,6 +1504,7 @@ submission_timestamp ASC ) ) AS startup_profile_selection_first_ping_only, + MIN(profile_group_id) AS profile_group_id, SUM( scalar_parent_browser_ui_interaction_textrecognition_error ) AS scalar_parent_browser_ui_interaction_textrecognition_error_sum, @@ -1573,9 +1575,200 @@ aggregates ) SELECT - * EXCEPT (map_sum_aggregates), - -- CAUTION: the order of fields here must match the order defined in - -- map_sum_aggregates above and offsets must increment on each line. + submission_date, + client_id, + aborts_content_sum, + aborts_gmplugin_sum, + aborts_plugin_sum, + active_addons_count_mean, + active_addons, + active_experiment_branch, + active_hours_sum, + addon_compatibility_check_enabled, + app_build_id, + app_display_version, + app_name, + app_version, + attribution, + blocklist_enabled, + channel, + client_clock_skew_mean, + client_submission_latency_mean, + cpu_cores, + cpu_count, + cpu_family, + cpu_l2_cache_kb, + cpu_l3_cache_kb, + cpu_model, + cpu_speed_mhz, + cpu_stepping, + cpu_vendor, + crashes_detected_content_sum, + crashes_detected_gmplugin_sum, + crashes_detected_plugin_sum, + crash_submit_attempt_content_sum, + crash_submit_attempt_main_sum, + crash_submit_attempt_plugin_sum, + crash_submit_success_content_sum, + crash_submit_success_main_sum, + crash_submit_success_plugin_sum, + default_search_engine, + default_search_engine_data_load_path, + default_search_engine_data_name, + default_search_engine_data_origin, + default_search_engine_data_submission_url, + devtools_toolbox_opened_count_sum, + distribution_id, + e10s_enabled, + env_build_arch, + env_build_id, + env_build_version, + environment_settings_intl_accept_languages, + environment_settings_intl_app_locales, + environment_settings_intl_available_locales, + environment_settings_intl_requested_locales, + environment_settings_intl_system_locales, + environment_settings_intl_regional_prefs_locales, + experiments, + first_paint_mean, + flash_version, + country, + city, + geo_subdivision1, + geo_subdivision2, + isp_name, + isp_organization, + gfx_features_advanced_layers_status, + gfx_features_d2d_status, + gfx_features_d3d11_status, + gfx_features_gpu_process_status, + histogram_parent_devtools_aboutdebugging_opened_count_sum, + histogram_parent_devtools_animationinspector_opened_count_sum, + histogram_parent_devtools_browserconsole_opened_count_sum, + histogram_parent_devtools_canvasdebugger_opened_count_sum, + histogram_parent_devtools_computedview_opened_count_sum, + histogram_parent_devtools_custom_opened_count_sum, + histogram_parent_devtools_developertoolbar_opened_count_sum, + histogram_parent_devtools_dom_opened_count_sum, + histogram_parent_devtools_eyedropper_opened_count_sum, + histogram_parent_devtools_fontinspector_opened_count_sum, + histogram_parent_devtools_inspector_opened_count_sum, + histogram_parent_devtools_jsbrowserdebugger_opened_count_sum, + histogram_parent_devtools_jsdebugger_opened_count_sum, + histogram_parent_devtools_jsprofiler_opened_count_sum, + histogram_parent_devtools_layoutview_opened_count_sum, + histogram_parent_devtools_memory_opened_count_sum, + histogram_parent_devtools_menu_eyedropper_opened_count_sum, + histogram_parent_devtools_netmonitor_opened_count_sum, + histogram_parent_devtools_options_opened_count_sum, + histogram_parent_devtools_paintflashing_opened_count_sum, + histogram_parent_devtools_picker_eyedropper_opened_count_sum, + histogram_parent_devtools_responsive_opened_count_sum, + histogram_parent_devtools_ruleview_opened_count_sum, + histogram_parent_devtools_scratchpad_opened_count_sum, + histogram_parent_devtools_scratchpad_window_opened_count_sum, + histogram_parent_devtools_shadereditor_opened_count_sum, + histogram_parent_devtools_storage_opened_count_sum, + histogram_parent_devtools_styleeditor_opened_count_sum, + histogram_parent_devtools_webaudioeditor_opened_count_sum, + histogram_parent_devtools_webconsole_opened_count_sum, + histogram_parent_devtools_webide_opened_count_sum, + install_year, + is_default_browser, + is_wow64, + locale, + memory_mb, + normalized_channel, + normalized_os_version, + os, + os_service_pack_major, + os_service_pack_minor, + os_version, + pings_aggregated_by_this_row, + places_bookmarks_count_mean, + places_pages_count_mean, + plugin_hangs_sum, + plugins_infobar_allow_sum, + plugins_infobar_block_sum, + plugins_infobar_shown_sum, + plugins_notification_shown_sum, + previous_build_id, + profile_age_in_days, + profile_creation_date, + push_api_notify_sum, + sample_id, + sandbox_effective_content_process_level, + scalar_combined_webrtc_nicer_stun_retransmits_sum, + scalar_combined_webrtc_nicer_turn_401s_sum, + scalar_combined_webrtc_nicer_turn_403s_sum, + scalar_combined_webrtc_nicer_turn_438s_sum, + scalar_content_navigator_storage_estimate_count_sum, + scalar_content_navigator_storage_persist_count_sum, + scalar_parent_aushelper_websense_reg_version, + scalar_parent_browser_engagement_max_concurrent_tab_count_max, + scalar_parent_browser_engagement_max_concurrent_window_count_max, + scalar_parent_browser_engagement_tab_open_event_count_sum, + scalar_parent_browser_engagement_total_uri_count_sum, + scalar_parent_browser_engagement_unfiltered_uri_count_sum, + scalar_parent_browser_engagement_unique_domains_count_max, + scalar_parent_browser_engagement_unique_domains_count_mean, + scalar_parent_browser_engagement_window_open_event_count_sum, + scalar_parent_devtools_accessibility_node_inspected_count_sum, + scalar_parent_devtools_accessibility_opened_count_sum, + scalar_parent_devtools_accessibility_picker_used_count_sum, + scalar_parent_devtools_accessibility_select_accessible_for_node_sum, + scalar_parent_devtools_accessibility_service_enabled_count_sum, + scalar_parent_devtools_copy_full_css_selector_opened_sum, + scalar_parent_devtools_copy_unique_css_selector_opened_sum, + scalar_parent_devtools_toolbar_eyedropper_opened_sum, + scalar_parent_dom_contentprocess_troubled_due_to_memory_sum, + scalar_parent_navigator_storage_estimate_count_sum, + scalar_parent_navigator_storage_persist_count_sum, + scalar_parent_storage_sync_api_usage_extensions_using_sum, + search_cohort, + search_count_abouthome, + search_count_contextmenu, + search_count_newtab, + search_count_searchbar, + search_count_system, + search_count_urlbar, + search_count_all, + search_count_tagged_sap, + search_count_tagged_follow_on, + search_count_organic, + search_count_urlbar_handoff, + session_restored_mean, + sessions_started_on_this_day, + shutdown_kill_sum, + subsession_hours_sum, + ssl_handshake_result_failure_sum, + ssl_handshake_result_success_sum, + sync_configured, + sync_count_desktop_mean, + sync_count_mobile_mean, + sync_count_desktop_sum, + sync_count_mobile_sum, + telemetry_enabled, + timezone_offset, + total_hours_sum, + update_auto_download, + update_channel, + update_enabled, + vendor, + web_notification_shown_sum, + windows_build_number, + windows_ubr, + fxa_configured, + trackers_blocked_sum, + submission_timestamp_min, + ad_clicks_count_all, + search_with_ads_count_all, + scalar_parent_urlbar_impression_autofill_about_sum, + scalar_parent_urlbar_impression_autofill_adaptive_sum, + scalar_parent_urlbar_impression_autofill_origin_sum, + scalar_parent_urlbar_impression_autofill_other_sum, + scalar_parent_urlbar_impression_autofill_preloaded_sum, + scalar_parent_urlbar_impression_autofill_url_sum, map_sum_aggregates[OFFSET(0)].map AS scalar_parent_telemetry_event_counts_sum, map_sum_aggregates[OFFSET(1)].map AS scalar_content_telemetry_event_counts_sum, map_sum_aggregates[OFFSET(2)].map AS scalar_parent_urlbar_searchmode_bookmarkmenu_sum, @@ -1591,6 +1784,15 @@ map_sum_aggregates[OFFSET(12)].map AS scalar_parent_urlbar_searchmode_topsites_urlbar_sum, map_sum_aggregates[OFFSET(13)].map AS scalar_parent_urlbar_searchmode_touchbar_sum, map_sum_aggregates[OFFSET(14)].map AS scalar_parent_urlbar_searchmode_typed_sum, + scalar_parent_os_environment_is_taskbar_pinned, + scalar_parent_os_environment_launched_via_desktop, + scalar_parent_os_environment_launched_via_taskbar, + scalar_parent_os_environment_launched_via_other, + scalar_parent_os_environment_launched_via_start_menu, + scalar_parent_os_environment_launched_via_other_shortcut, + search_count_webextension, + search_count_alias, + search_count_urlbar_searchmode, map_sum_aggregates[ OFFSET(15) ].map AS scalar_parent_browser_ui_interaction_preferences_pane_home_sum, @@ -1616,9 +1818,17 @@ map_sum_aggregates[OFFSET(35)].map AS scalar_parent_urlbar_picked_topsite_sum, map_sum_aggregates[OFFSET(36)].map AS scalar_parent_urlbar_picked_unknown_sum, map_sum_aggregates[OFFSET(37)].map AS scalar_parent_urlbar_picked_visiturl_sum, + default_private_search_engine, + default_private_search_engine_data_load_path, + default_private_search_engine_data_name, + default_private_search_engine_data_origin, + default_private_search_engine_data_submission_url, + search_counts, + user_pref_browser_search_region, map_sum_aggregates[OFFSET(38)].map AS search_with_ads, map_sum_aggregates[OFFSET(39)].map AS ad_clicks, map_sum_aggregates[OFFSET(40)].map AS search_content_urlbar_sum, + map_sum_aggregates[OFFSET(73)].map AS search_content_urlbar_handoff_sum, map_sum_aggregates[OFFSET(41)].map AS search_content_urlbar_searchmode_sum, map_sum_aggregates[OFFSET(42)].map AS search_content_contextmenu_sum, map_sum_aggregates[OFFSET(43)].map AS search_content_about_home_sum, @@ -1630,6 +1840,7 @@ map_sum_aggregates[OFFSET(49)].map AS search_content_reload_sum, map_sum_aggregates[OFFSET(50)].map AS search_content_unknown_sum, map_sum_aggregates[OFFSET(51)].map AS search_withads_urlbar_sum, + map_sum_aggregates[OFFSET(74)].map AS search_withads_urlbar_handoff_sum, map_sum_aggregates[OFFSET(52)].map AS search_withads_urlbar_searchmode_sum, map_sum_aggregates[OFFSET(53)].map AS search_withads_contextmenu_sum, map_sum_aggregates[OFFSET(54)].map AS search_withads_about_home_sum, @@ -1641,6 +1852,7 @@ map_sum_aggregates[OFFSET(60)].map AS search_withads_reload_sum, map_sum_aggregates[OFFSET(61)].map AS search_withads_unknown_sum, map_sum_aggregates[OFFSET(62)].map AS search_adclicks_urlbar_sum, + map_sum_aggregates[OFFSET(75)].map AS search_adclicks_urlbar_handoff_sum, map_sum_aggregates[OFFSET(63)].map AS search_adclicks_urlbar_searchmode_sum, map_sum_aggregates[OFFSET(64)].map AS search_adclicks_contextmenu_sum, map_sum_aggregates[OFFSET(65)].map AS search_adclicks_about_home_sum, @@ -1651,71 +1863,132 @@ map_sum_aggregates[OFFSET(70)].map AS search_adclicks_tabhistory_sum, map_sum_aggregates[OFFSET(71)].map AS search_adclicks_reload_sum, map_sum_aggregates[OFFSET(72)].map AS search_adclicks_unknown_sum, - map_sum_aggregates[OFFSET(73)].map AS search_content_urlbar_handoff_sum, - map_sum_aggregates[OFFSET(74)].map AS search_withads_urlbar_handoff_sum, - map_sum_aggregates[OFFSET(75)].map AS search_adclicks_urlbar_handoff_sum, + update_background, + user_pref_browser_search_suggest_enabled, + user_pref_browser_widget_in_navbar, + user_pref_browser_urlbar_suggest_searches, + user_pref_browser_urlbar_show_search_suggestions_first, + user_pref_browser_urlbar_suggest_quicksuggest, + user_pref_browser_urlbar_suggest_quicksuggest_sponsored, + user_pref_browser_urlbar_quicksuggest_onboarding_dialog_choice, + scalar_parent_browser_engagement_total_uri_count_normal_and_private_mode_sum, + user_pref_browser_newtabpage_enabled, + user_pref_app_shield_optoutstudies_enabled, + map_sum_aggregates[OFFSET(82)].map AS contextual_services_quicksuggest_click_sum, + map_sum_aggregates[OFFSET(96)].map AS contextual_services_quicksuggest_impression_sum, + map_sum_aggregates[OFFSET(89)].map AS contextual_services_quicksuggest_help_sum, + map_sum_aggregates[OFFSET(103)].map AS contextual_services_topsites_click_sum, + map_sum_aggregates[OFFSET(104)].map AS contextual_services_topsites_impression_sum, + user_pref_browser_urlbar_suggest_quicksuggest_nonsponsored, + user_pref_browser_urlbar_quicksuggest_data_collection_enabled, + scalar_a11y_hcm_foreground, + scalar_a11y_hcm_background, + a11y_theme, map_sum_aggregates[ - OFFSET(76) - ].map AS contextual_services_quicksuggest_block_dynamic_wikipedia_sum, - map_sum_aggregates[OFFSET(77)].map AS contextual_services_quicksuggest_block_nonsponsored_sum, + OFFSET(92) + ].map AS contextual_services_quicksuggest_help_nonsponsored_bestmatch_sum, map_sum_aggregates[ - OFFSET(78) - ].map AS contextual_services_quicksuggest_block_nonsponsored_bestmatch_sum, + OFFSET(94) + ].map AS contextual_services_quicksuggest_help_sponsored_bestmatch_sum, + map_sum_aggregates[OFFSET(77)].map AS contextual_services_quicksuggest_block_nonsponsored_sum, map_sum_aggregates[OFFSET(79)].map AS contextual_services_quicksuggest_block_sponsored_sum, map_sum_aggregates[ OFFSET(80) ].map AS contextual_services_quicksuggest_block_sponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(78) + ].map AS contextual_services_quicksuggest_block_nonsponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(87) + ].map AS contextual_services_quicksuggest_click_sponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(85) + ].map AS contextual_services_quicksuggest_click_nonsponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(101) + ].map AS contextual_services_quicksuggest_impression_sponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(99) + ].map AS contextual_services_quicksuggest_impression_nonsponsored_bestmatch_sum, + user_pref_browser_urlbar_suggest_bestmatch, + scalar_parent_browser_ui_interaction_textrecognition_error_sum, + text_recognition_interaction_timing_sum, + text_recognition_interaction_timing_count_sum, + map_sum_aggregates[OFFSET(105)].map AS scalar_parent_browser_ui_interaction_content_context_sum, + text_recognition_api_performance_sum, + text_recognition_api_performance_count_sum, + text_recognition_text_length_sum, + text_recognition_text_length_count_sum, + scalar_parent_os_environment_launched_via_taskbar_private, + dom_parentprocess_private_window_used, + os_environment_is_taskbar_pinned_any, + os_environment_is_taskbar_pinned_private_any, + os_environment_is_taskbar_pinned_private, + bookmark_migrations_quantity_chrome, + bookmark_migrations_quantity_edge, + bookmark_migrations_quantity_safari, + bookmark_migrations_quantity_all, + history_migrations_quantity_chrome, + history_migrations_quantity_edge, + history_migrations_quantity_safari, + history_migrations_quantity_all, + logins_migrations_quantity_chrome, + logins_migrations_quantity_edge, + logins_migrations_quantity_safari, + logins_migrations_quantity_all, + search_count_urlbar_persisted, + map_sum_aggregates[OFFSET(106)].map AS search_content_urlbar_persisted_sum, + map_sum_aggregates[OFFSET(107)].map AS search_withads_urlbar_persisted_sum, + map_sum_aggregates[OFFSET(108)].map AS search_adclicks_urlbar_persisted_sum, + media_play_time_ms_audio_sum, + media_play_time_ms_video_sum, + map_sum_aggregates[ + OFFSET(76) + ].map AS contextual_services_quicksuggest_block_dynamic_wikipedia_sum, map_sum_aggregates[OFFSET(81)].map AS contextual_services_quicksuggest_block_weather_sum, - map_sum_aggregates[OFFSET(82)].map AS contextual_services_quicksuggest_click_sum, map_sum_aggregates[ OFFSET(83) ].map AS contextual_services_quicksuggest_click_dynamic_wikipedia_sum, map_sum_aggregates[OFFSET(84)].map AS contextual_services_quicksuggest_click_nonsponsored_sum, - map_sum_aggregates[ - OFFSET(85) - ].map AS contextual_services_quicksuggest_click_nonsponsored_bestmatch_sum, map_sum_aggregates[OFFSET(86)].map AS contextual_services_quicksuggest_click_sponsored_sum, - map_sum_aggregates[ - OFFSET(87) - ].map AS contextual_services_quicksuggest_click_sponsored_bestmatch_sum, map_sum_aggregates[OFFSET(88)].map AS contextual_services_quicksuggest_click_weather_sum, - map_sum_aggregates[OFFSET(89)].map AS contextual_services_quicksuggest_help_sum, map_sum_aggregates[OFFSET(90)].map AS contextual_services_quicksuggest_help_dynamic_wikipedia_sum, map_sum_aggregates[OFFSET(91)].map AS contextual_services_quicksuggest_help_nonsponsored_sum, - map_sum_aggregates[ - OFFSET(92) - ].map AS contextual_services_quicksuggest_help_nonsponsored_bestmatch_sum, map_sum_aggregates[OFFSET(93)].map AS contextual_services_quicksuggest_help_sponsored_sum, - map_sum_aggregates[ - OFFSET(94) - ].map AS contextual_services_quicksuggest_help_sponsored_bestmatch_sum, map_sum_aggregates[OFFSET(95)].map AS contextual_services_quicksuggest_help_weather_sum, - map_sum_aggregates[OFFSET(96)].map AS contextual_services_quicksuggest_impression_sum, map_sum_aggregates[ OFFSET(97) ].map AS contextual_services_quicksuggest_impression_dynamic_wikipedia_sum, map_sum_aggregates[ OFFSET(98) ].map AS contextual_services_quicksuggest_impression_nonsponsored_sum, - map_sum_aggregates[ - OFFSET(99) - ].map AS contextual_services_quicksuggest_impression_nonsponsored_bestmatch_sum, map_sum_aggregates[OFFSET(100)].map AS contextual_services_quicksuggest_impression_sponsored_sum, - map_sum_aggregates[ - OFFSET(101) - ].map AS contextual_services_quicksuggest_impression_sponsored_bestmatch_sum, map_sum_aggregates[OFFSET(102)].map AS contextual_services_quicksuggest_impression_weather_sum, - map_sum_aggregates[OFFSET(103)].map AS contextual_services_topsites_click_sum, - map_sum_aggregates[OFFSET(104)].map AS contextual_services_topsites_impression_sum, - map_sum_aggregates[OFFSET(105)].map AS scalar_parent_browser_ui_interaction_content_context_sum, - map_sum_aggregates[OFFSET(106)].map AS search_content_urlbar_persisted_sum, - map_sum_aggregates[OFFSET(107)].map AS search_withads_urlbar_persisted_sum, - map_sum_aggregates[OFFSET(108)].map AS search_adclicks_urlbar_persisted_sum, + places_searchbar_cumulative_searches_sum, + places_searchbar_cumulative_filter_count_sum, map_sum_aggregates[OFFSET(109)].map AS scalar_parent_sidebar_opened_sum, map_sum_aggregates[OFFSET(110)].map AS scalar_parent_sidebar_search_sum, map_sum_aggregates[OFFSET(111)].map AS scalar_parent_sidebar_link_sum, + places_previousday_visits_mean, + places_library_cumulative_bookmark_searches_sum, + places_library_cumulative_history_searches_sum, + places_bookmarks_searchbar_cumulative_searches_sum, map_sum_aggregates[OFFSET(112)].map AS scalar_parent_library_link_sum, map_sum_aggregates[OFFSET(113)].map AS scalar_parent_library_opened_sum, map_sum_aggregates[OFFSET(114)].map AS scalar_parent_library_search_sum, + startup_profile_selection_reason_first, + first_document_id, + partner_id, + distribution_version, + distributor, + distributor_channel, + env_build_platform_version, + env_build_xpcom_abi, + geo_db_version, + apple_model_id, + max_subsession_counter, + min_subsession_counter, + startup_profile_selection_first_ping_only, + profile_group_id FROM udf_aggregates diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml 2024-08-07 15:34:10.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml 2024-08-07 15:34:11.000000000 +0000 @@ -765,9 +765,6 @@ - mode: NULLABLE name: search_count_urlbar_handoff type: INTEGER -- mode: NULLABLE - name: search_count_urlbar_persisted - type: INTEGER - description: null mode: NULLABLE name: session_restored_mean @@ -1427,16 +1424,6 @@ name: value type: INTEGER mode: REPEATED - name: search_content_urlbar_persisted_sum - type: RECORD -- fields: - - mode: NULLABLE - name: key - type: STRING - - mode: NULLABLE - name: value - type: INTEGER - mode: REPEATED name: search_content_urlbar_searchmode_sum type: RECORD - fields: @@ -1557,16 +1544,6 @@ name: value type: INTEGER mode: REPEATED - name: search_withads_urlbar_persisted_sum - type: RECORD -- fields: - - mode: NULLABLE - name: key - type: STRING - - mode: NULLABLE - name: value - type: INTEGER - mode: REPEATED name: search_withads_urlbar_searchmode_sum type: RECORD - fields: @@ -1687,16 +1664,6 @@ name: value type: INTEGER mode: REPEATED - name: search_adclicks_urlbar_persisted_sum - type: RECORD -- fields: - - mode: NULLABLE - name: key - type: STRING - - mode: NULLABLE - name: value - type: INTEGER - mode: REPEATED name: search_adclicks_urlbar_searchmode_sum type: RECORD - fields: @@ -2029,12 +1996,6 @@ name: text_recognition_text_length_count_sum type: INTEGER - mode: NULLABLE - name: places_searchbar_cumulative_searches_sum - type: INTEGER -- mode: NULLABLE - name: places_searchbar_cumulative_filter_count_sum - type: INTEGER -- mode: NULLABLE name: scalar_parent_os_environment_launched_via_taskbar_private type: BOOLEAN - mode: NULLABLE @@ -2073,6 +2034,26 @@ - mode: NULLABLE name: history_migrations_quantity_all type: INTEGER +- fields: + - mode: NULLABLE + name: key + type: STRING + - mode: NULLABLE + name: value + type: INTEGER + mode: REPEATED + name: search_withads_urlbar_persisted_sum + type: RECORD +- fields: + - mode: NULLABLE + name: key + type: STRING + - mode: NULLABLE + name: value + type: INTEGER + mode: REPEATED + name: search_adclicks_urlbar_persisted_sum + type: RECORD - mode: NULLABLE name: logins_migrations_quantity_chrome type: INTEGER @@ -2086,6 +2067,19 @@ name: logins_migrations_quantity_all type: INTEGER - mode: NULLABLE + name: search_count_urlbar_persisted + type: INTEGER +- fields: + - mode: NULLABLE + name: key + type: STRING + - mode: NULLABLE + name: value + type: INTEGER + mode: REPEATED + name: search_content_urlbar_persisted_sum + type: RECORD +- mode: NULLABLE name: media_play_time_ms_audio_sum type: INTEGER - mode: NULLABLE @@ -2231,6 +2225,12 @@ mode: REPEATED name: contextual_services_quicksuggest_impression_weather_sum type: RECORD +- mode: NULLABLE + name: places_searchbar_cumulative_searches_sum + type: INTEGER +- mode: NULLABLE + name: places_searchbar_cumulative_filter_count_sum + type: INTEGER - fields: - mode: NULLABLE name: key @@ -2342,3 +2342,7 @@ - name: startup_profile_selection_first_ping_only type: STRING mode: NULLABLE +- name: profile_group_id + type: STRING + mode: NULLABLE + description: A UUID identifying the profile's group on a single device and allowing user-oriented correlation of data ```

Link to full diff

[dataops-ci-bot]

Integration report for "DENG-4446 fix order to match prod BQ table"

sql.diff

Click to expand!

```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql 2024-08-07 15:53:16.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/query.sql 2024-08-07 15:53:11.000000000 +0000 @@ -180,6 +180,7 @@ submission_timestamp, client_id, sample_id, + profile_group_id, document_id, metadata.uri.app_update_channel AS channel, normalized_channel, @@ -1503,6 +1504,7 @@ submission_timestamp ASC ) ) AS startup_profile_selection_first_ping_only, + MIN(profile_group_id) AS profile_group_id, SUM( scalar_parent_browser_ui_interaction_textrecognition_error ) AS scalar_parent_browser_ui_interaction_textrecognition_error_sum, @@ -1573,9 +1575,200 @@ aggregates ) SELECT - * EXCEPT (map_sum_aggregates), - -- CAUTION: the order of fields here must match the order defined in - -- map_sum_aggregates above and offsets must increment on each line. + submission_date, + client_id, + aborts_content_sum, + aborts_gmplugin_sum, + aborts_plugin_sum, + active_addons_count_mean, + active_addons, + active_experiment_branch, + active_hours_sum, + addon_compatibility_check_enabled, + app_build_id, + app_display_version, + app_name, + app_version, + attribution, + blocklist_enabled, + channel, + client_clock_skew_mean, + client_submission_latency_mean, + cpu_cores, + cpu_count, + cpu_family, + cpu_l2_cache_kb, + cpu_l3_cache_kb, + cpu_model, + cpu_speed_mhz, + cpu_stepping, + cpu_vendor, + crashes_detected_content_sum, + crashes_detected_gmplugin_sum, + crashes_detected_plugin_sum, + crash_submit_attempt_content_sum, + crash_submit_attempt_main_sum, + crash_submit_attempt_plugin_sum, + crash_submit_success_content_sum, + crash_submit_success_main_sum, + crash_submit_success_plugin_sum, + default_search_engine, + default_search_engine_data_load_path, + default_search_engine_data_name, + default_search_engine_data_origin, + default_search_engine_data_submission_url, + devtools_toolbox_opened_count_sum, + distribution_id, + e10s_enabled, + env_build_arch, + env_build_id, + env_build_version, + environment_settings_intl_accept_languages, + environment_settings_intl_app_locales, + environment_settings_intl_available_locales, + environment_settings_intl_requested_locales, + environment_settings_intl_system_locales, + environment_settings_intl_regional_prefs_locales, + experiments, + first_paint_mean, + flash_version, + country, + city, + geo_subdivision1, + geo_subdivision2, + isp_name, + isp_organization, + gfx_features_advanced_layers_status, + gfx_features_d2d_status, + gfx_features_d3d11_status, + gfx_features_gpu_process_status, + histogram_parent_devtools_aboutdebugging_opened_count_sum, + histogram_parent_devtools_animationinspector_opened_count_sum, + histogram_parent_devtools_browserconsole_opened_count_sum, + histogram_parent_devtools_canvasdebugger_opened_count_sum, + histogram_parent_devtools_computedview_opened_count_sum, + histogram_parent_devtools_custom_opened_count_sum, + histogram_parent_devtools_developertoolbar_opened_count_sum, + histogram_parent_devtools_dom_opened_count_sum, + histogram_parent_devtools_eyedropper_opened_count_sum, + histogram_parent_devtools_fontinspector_opened_count_sum, + histogram_parent_devtools_inspector_opened_count_sum, + histogram_parent_devtools_jsbrowserdebugger_opened_count_sum, + histogram_parent_devtools_jsdebugger_opened_count_sum, + histogram_parent_devtools_jsprofiler_opened_count_sum, + histogram_parent_devtools_layoutview_opened_count_sum, + histogram_parent_devtools_memory_opened_count_sum, + histogram_parent_devtools_menu_eyedropper_opened_count_sum, + histogram_parent_devtools_netmonitor_opened_count_sum, + histogram_parent_devtools_options_opened_count_sum, + histogram_parent_devtools_paintflashing_opened_count_sum, + histogram_parent_devtools_picker_eyedropper_opened_count_sum, + histogram_parent_devtools_responsive_opened_count_sum, + histogram_parent_devtools_ruleview_opened_count_sum, + histogram_parent_devtools_scratchpad_opened_count_sum, + histogram_parent_devtools_scratchpad_window_opened_count_sum, + histogram_parent_devtools_shadereditor_opened_count_sum, + histogram_parent_devtools_storage_opened_count_sum, + histogram_parent_devtools_styleeditor_opened_count_sum, + histogram_parent_devtools_webaudioeditor_opened_count_sum, + histogram_parent_devtools_webconsole_opened_count_sum, + histogram_parent_devtools_webide_opened_count_sum, + install_year, + is_default_browser, + is_wow64, + locale, + memory_mb, + normalized_channel, + normalized_os_version, + os, + os_service_pack_major, + os_service_pack_minor, + os_version, + pings_aggregated_by_this_row, + places_bookmarks_count_mean, + places_pages_count_mean, + plugin_hangs_sum, + plugins_infobar_allow_sum, + plugins_infobar_block_sum, + plugins_infobar_shown_sum, + plugins_notification_shown_sum, + previous_build_id, + profile_age_in_days, + profile_creation_date, + push_api_notify_sum, + sample_id, + sandbox_effective_content_process_level, + scalar_combined_webrtc_nicer_stun_retransmits_sum, + scalar_combined_webrtc_nicer_turn_401s_sum, + scalar_combined_webrtc_nicer_turn_403s_sum, + scalar_combined_webrtc_nicer_turn_438s_sum, + scalar_content_navigator_storage_estimate_count_sum, + scalar_content_navigator_storage_persist_count_sum, + scalar_parent_aushelper_websense_reg_version, + scalar_parent_browser_engagement_max_concurrent_tab_count_max, + scalar_parent_browser_engagement_max_concurrent_window_count_max, + scalar_parent_browser_engagement_tab_open_event_count_sum, + scalar_parent_browser_engagement_total_uri_count_sum, + scalar_parent_browser_engagement_unfiltered_uri_count_sum, + scalar_parent_browser_engagement_unique_domains_count_max, + scalar_parent_browser_engagement_unique_domains_count_mean, + scalar_parent_browser_engagement_window_open_event_count_sum, + scalar_parent_devtools_accessibility_node_inspected_count_sum, + scalar_parent_devtools_accessibility_opened_count_sum, + scalar_parent_devtools_accessibility_picker_used_count_sum, + scalar_parent_devtools_accessibility_select_accessible_for_node_sum, + scalar_parent_devtools_accessibility_service_enabled_count_sum, + scalar_parent_devtools_copy_full_css_selector_opened_sum, + scalar_parent_devtools_copy_unique_css_selector_opened_sum, + scalar_parent_devtools_toolbar_eyedropper_opened_sum, + scalar_parent_dom_contentprocess_troubled_due_to_memory_sum, + scalar_parent_navigator_storage_estimate_count_sum, + scalar_parent_navigator_storage_persist_count_sum, + scalar_parent_storage_sync_api_usage_extensions_using_sum, + search_cohort, + search_count_abouthome, + search_count_contextmenu, + search_count_newtab, + search_count_searchbar, + search_count_system, + search_count_urlbar, + search_count_all, + search_count_tagged_sap, + search_count_tagged_follow_on, + search_count_organic, + search_count_urlbar_handoff, + session_restored_mean, + sessions_started_on_this_day, + shutdown_kill_sum, + subsession_hours_sum, + ssl_handshake_result_failure_sum, + ssl_handshake_result_success_sum, + sync_configured, + sync_count_desktop_mean, + sync_count_mobile_mean, + sync_count_desktop_sum, + sync_count_mobile_sum, + telemetry_enabled, + timezone_offset, + total_hours_sum, + update_auto_download, + update_channel, + update_enabled, + vendor, + web_notification_shown_sum, + windows_build_number, + windows_ubr, + fxa_configured, + trackers_blocked_sum, + submission_timestamp_min, + ad_clicks_count_all, + search_with_ads_count_all, + scalar_parent_urlbar_impression_autofill_about_sum, + scalar_parent_urlbar_impression_autofill_adaptive_sum, + scalar_parent_urlbar_impression_autofill_origin_sum, + scalar_parent_urlbar_impression_autofill_other_sum, + scalar_parent_urlbar_impression_autofill_preloaded_sum, + scalar_parent_urlbar_impression_autofill_url_sum, map_sum_aggregates[OFFSET(0)].map AS scalar_parent_telemetry_event_counts_sum, map_sum_aggregates[OFFSET(1)].map AS scalar_content_telemetry_event_counts_sum, map_sum_aggregates[OFFSET(2)].map AS scalar_parent_urlbar_searchmode_bookmarkmenu_sum, @@ -1591,6 +1784,15 @@ map_sum_aggregates[OFFSET(12)].map AS scalar_parent_urlbar_searchmode_topsites_urlbar_sum, map_sum_aggregates[OFFSET(13)].map AS scalar_parent_urlbar_searchmode_touchbar_sum, map_sum_aggregates[OFFSET(14)].map AS scalar_parent_urlbar_searchmode_typed_sum, + scalar_parent_os_environment_is_taskbar_pinned, + scalar_parent_os_environment_launched_via_desktop, + scalar_parent_os_environment_launched_via_taskbar, + scalar_parent_os_environment_launched_via_other, + scalar_parent_os_environment_launched_via_start_menu, + scalar_parent_os_environment_launched_via_other_shortcut, + search_count_webextension, + search_count_alias, + search_count_urlbar_searchmode, map_sum_aggregates[ OFFSET(15) ].map AS scalar_parent_browser_ui_interaction_preferences_pane_home_sum, @@ -1616,9 +1818,17 @@ map_sum_aggregates[OFFSET(35)].map AS scalar_parent_urlbar_picked_topsite_sum, map_sum_aggregates[OFFSET(36)].map AS scalar_parent_urlbar_picked_unknown_sum, map_sum_aggregates[OFFSET(37)].map AS scalar_parent_urlbar_picked_visiturl_sum, + default_private_search_engine, + default_private_search_engine_data_load_path, + default_private_search_engine_data_name, + default_private_search_engine_data_origin, + default_private_search_engine_data_submission_url, + search_counts, + user_pref_browser_search_region, map_sum_aggregates[OFFSET(38)].map AS search_with_ads, map_sum_aggregates[OFFSET(39)].map AS ad_clicks, map_sum_aggregates[OFFSET(40)].map AS search_content_urlbar_sum, + map_sum_aggregates[OFFSET(73)].map AS search_content_urlbar_handoff_sum, map_sum_aggregates[OFFSET(41)].map AS search_content_urlbar_searchmode_sum, map_sum_aggregates[OFFSET(42)].map AS search_content_contextmenu_sum, map_sum_aggregates[OFFSET(43)].map AS search_content_about_home_sum, @@ -1630,6 +1840,7 @@ map_sum_aggregates[OFFSET(49)].map AS search_content_reload_sum, map_sum_aggregates[OFFSET(50)].map AS search_content_unknown_sum, map_sum_aggregates[OFFSET(51)].map AS search_withads_urlbar_sum, + map_sum_aggregates[OFFSET(74)].map AS search_withads_urlbar_handoff_sum, map_sum_aggregates[OFFSET(52)].map AS search_withads_urlbar_searchmode_sum, map_sum_aggregates[OFFSET(53)].map AS search_withads_contextmenu_sum, map_sum_aggregates[OFFSET(54)].map AS search_withads_about_home_sum, @@ -1641,6 +1852,7 @@ map_sum_aggregates[OFFSET(60)].map AS search_withads_reload_sum, map_sum_aggregates[OFFSET(61)].map AS search_withads_unknown_sum, map_sum_aggregates[OFFSET(62)].map AS search_adclicks_urlbar_sum, + map_sum_aggregates[OFFSET(75)].map AS search_adclicks_urlbar_handoff_sum, map_sum_aggregates[OFFSET(63)].map AS search_adclicks_urlbar_searchmode_sum, map_sum_aggregates[OFFSET(64)].map AS search_adclicks_contextmenu_sum, map_sum_aggregates[OFFSET(65)].map AS search_adclicks_about_home_sum, @@ -1651,71 +1863,132 @@ map_sum_aggregates[OFFSET(70)].map AS search_adclicks_tabhistory_sum, map_sum_aggregates[OFFSET(71)].map AS search_adclicks_reload_sum, map_sum_aggregates[OFFSET(72)].map AS search_adclicks_unknown_sum, - map_sum_aggregates[OFFSET(73)].map AS search_content_urlbar_handoff_sum, - map_sum_aggregates[OFFSET(74)].map AS search_withads_urlbar_handoff_sum, - map_sum_aggregates[OFFSET(75)].map AS search_adclicks_urlbar_handoff_sum, + update_background, + user_pref_browser_search_suggest_enabled, + user_pref_browser_widget_in_navbar, + user_pref_browser_urlbar_suggest_searches, + user_pref_browser_urlbar_show_search_suggestions_first, + user_pref_browser_urlbar_suggest_quicksuggest, + user_pref_browser_urlbar_suggest_quicksuggest_sponsored, + user_pref_browser_urlbar_quicksuggest_onboarding_dialog_choice, + scalar_parent_browser_engagement_total_uri_count_normal_and_private_mode_sum, + user_pref_browser_newtabpage_enabled, + user_pref_app_shield_optoutstudies_enabled, + map_sum_aggregates[OFFSET(82)].map AS contextual_services_quicksuggest_click_sum, + map_sum_aggregates[OFFSET(96)].map AS contextual_services_quicksuggest_impression_sum, + map_sum_aggregates[OFFSET(89)].map AS contextual_services_quicksuggest_help_sum, + map_sum_aggregates[OFFSET(103)].map AS contextual_services_topsites_click_sum, + map_sum_aggregates[OFFSET(104)].map AS contextual_services_topsites_impression_sum, + user_pref_browser_urlbar_suggest_quicksuggest_nonsponsored, + user_pref_browser_urlbar_quicksuggest_data_collection_enabled, + scalar_a11y_hcm_foreground, + scalar_a11y_hcm_background, + a11y_theme, map_sum_aggregates[ - OFFSET(76) - ].map AS contextual_services_quicksuggest_block_dynamic_wikipedia_sum, - map_sum_aggregates[OFFSET(77)].map AS contextual_services_quicksuggest_block_nonsponsored_sum, + OFFSET(92) + ].map AS contextual_services_quicksuggest_help_nonsponsored_bestmatch_sum, map_sum_aggregates[ - OFFSET(78) - ].map AS contextual_services_quicksuggest_block_nonsponsored_bestmatch_sum, + OFFSET(94) + ].map AS contextual_services_quicksuggest_help_sponsored_bestmatch_sum, + map_sum_aggregates[OFFSET(77)].map AS contextual_services_quicksuggest_block_nonsponsored_sum, map_sum_aggregates[OFFSET(79)].map AS contextual_services_quicksuggest_block_sponsored_sum, map_sum_aggregates[ OFFSET(80) ].map AS contextual_services_quicksuggest_block_sponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(78) + ].map AS contextual_services_quicksuggest_block_nonsponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(87) + ].map AS contextual_services_quicksuggest_click_sponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(85) + ].map AS contextual_services_quicksuggest_click_nonsponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(101) + ].map AS contextual_services_quicksuggest_impression_sponsored_bestmatch_sum, + map_sum_aggregates[ + OFFSET(99) + ].map AS contextual_services_quicksuggest_impression_nonsponsored_bestmatch_sum, + user_pref_browser_urlbar_suggest_bestmatch, + scalar_parent_browser_ui_interaction_textrecognition_error_sum, + text_recognition_interaction_timing_sum, + text_recognition_interaction_timing_count_sum, + map_sum_aggregates[OFFSET(105)].map AS scalar_parent_browser_ui_interaction_content_context_sum, + text_recognition_api_performance_sum, + text_recognition_api_performance_count_sum, + text_recognition_text_length_sum, + text_recognition_text_length_count_sum, + scalar_parent_os_environment_launched_via_taskbar_private, + dom_parentprocess_private_window_used, + os_environment_is_taskbar_pinned_any, + os_environment_is_taskbar_pinned_private_any, + os_environment_is_taskbar_pinned_private, + bookmark_migrations_quantity_chrome, + bookmark_migrations_quantity_edge, + bookmark_migrations_quantity_safari, + bookmark_migrations_quantity_all, + history_migrations_quantity_chrome, + history_migrations_quantity_edge, + history_migrations_quantity_safari, + history_migrations_quantity_all, + logins_migrations_quantity_chrome, + logins_migrations_quantity_edge, + logins_migrations_quantity_safari, + logins_migrations_quantity_all, + search_count_urlbar_persisted, + map_sum_aggregates[OFFSET(106)].map AS search_content_urlbar_persisted_sum, + map_sum_aggregates[OFFSET(107)].map AS search_withads_urlbar_persisted_sum, + map_sum_aggregates[OFFSET(108)].map AS search_adclicks_urlbar_persisted_sum, + media_play_time_ms_audio_sum, + media_play_time_ms_video_sum, + map_sum_aggregates[ + OFFSET(76) + ].map AS contextual_services_quicksuggest_block_dynamic_wikipedia_sum, map_sum_aggregates[OFFSET(81)].map AS contextual_services_quicksuggest_block_weather_sum, - map_sum_aggregates[OFFSET(82)].map AS contextual_services_quicksuggest_click_sum, map_sum_aggregates[ OFFSET(83) ].map AS contextual_services_quicksuggest_click_dynamic_wikipedia_sum, map_sum_aggregates[OFFSET(84)].map AS contextual_services_quicksuggest_click_nonsponsored_sum, - map_sum_aggregates[ - OFFSET(85) - ].map AS contextual_services_quicksuggest_click_nonsponsored_bestmatch_sum, map_sum_aggregates[OFFSET(86)].map AS contextual_services_quicksuggest_click_sponsored_sum, - map_sum_aggregates[ - OFFSET(87) - ].map AS contextual_services_quicksuggest_click_sponsored_bestmatch_sum, map_sum_aggregates[OFFSET(88)].map AS contextual_services_quicksuggest_click_weather_sum, - map_sum_aggregates[OFFSET(89)].map AS contextual_services_quicksuggest_help_sum, map_sum_aggregates[OFFSET(90)].map AS contextual_services_quicksuggest_help_dynamic_wikipedia_sum, map_sum_aggregates[OFFSET(91)].map AS contextual_services_quicksuggest_help_nonsponsored_sum, - map_sum_aggregates[ - OFFSET(92) - ].map AS contextual_services_quicksuggest_help_nonsponsored_bestmatch_sum, map_sum_aggregates[OFFSET(93)].map AS contextual_services_quicksuggest_help_sponsored_sum, - map_sum_aggregates[ - OFFSET(94) - ].map AS contextual_services_quicksuggest_help_sponsored_bestmatch_sum, map_sum_aggregates[OFFSET(95)].map AS contextual_services_quicksuggest_help_weather_sum, - map_sum_aggregates[OFFSET(96)].map AS contextual_services_quicksuggest_impression_sum, map_sum_aggregates[ OFFSET(97) ].map AS contextual_services_quicksuggest_impression_dynamic_wikipedia_sum, map_sum_aggregates[ OFFSET(98) ].map AS contextual_services_quicksuggest_impression_nonsponsored_sum, - map_sum_aggregates[ - OFFSET(99) - ].map AS contextual_services_quicksuggest_impression_nonsponsored_bestmatch_sum, map_sum_aggregates[OFFSET(100)].map AS contextual_services_quicksuggest_impression_sponsored_sum, - map_sum_aggregates[ - OFFSET(101) - ].map AS contextual_services_quicksuggest_impression_sponsored_bestmatch_sum, map_sum_aggregates[OFFSET(102)].map AS contextual_services_quicksuggest_impression_weather_sum, - map_sum_aggregates[OFFSET(103)].map AS contextual_services_topsites_click_sum, - map_sum_aggregates[OFFSET(104)].map AS contextual_services_topsites_impression_sum, - map_sum_aggregates[OFFSET(105)].map AS scalar_parent_browser_ui_interaction_content_context_sum, - map_sum_aggregates[OFFSET(106)].map AS search_content_urlbar_persisted_sum, - map_sum_aggregates[OFFSET(107)].map AS search_withads_urlbar_persisted_sum, - map_sum_aggregates[OFFSET(108)].map AS search_adclicks_urlbar_persisted_sum, + places_searchbar_cumulative_searches_sum, + places_searchbar_cumulative_filter_count_sum, map_sum_aggregates[OFFSET(109)].map AS scalar_parent_sidebar_opened_sum, map_sum_aggregates[OFFSET(110)].map AS scalar_parent_sidebar_search_sum, map_sum_aggregates[OFFSET(111)].map AS scalar_parent_sidebar_link_sum, + places_previousday_visits_mean, + places_library_cumulative_bookmark_searches_sum, + places_library_cumulative_history_searches_sum, + places_bookmarks_searchbar_cumulative_searches_sum, map_sum_aggregates[OFFSET(112)].map AS scalar_parent_library_link_sum, map_sum_aggregates[OFFSET(113)].map AS scalar_parent_library_opened_sum, map_sum_aggregates[OFFSET(114)].map AS scalar_parent_library_search_sum, + startup_profile_selection_reason_first, + first_document_id, + partner_id, + distribution_version, + distributor, + distributor_channel, + env_build_platform_version, + env_build_xpcom_abi, + geo_db_version, + apple_model_id, + max_subsession_counter, + min_subsession_counter, + startup_profile_selection_first_ping_only, + profile_group_id FROM udf_aggregates diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml 2024-08-07 15:53:16.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/telemetry_derived/clients_daily_v6/schema.yaml 2024-08-07 15:53:11.000000000 +0000 @@ -765,9 +765,6 @@ - mode: NULLABLE name: search_count_urlbar_handoff type: INTEGER -- mode: NULLABLE - name: search_count_urlbar_persisted - type: INTEGER - description: null mode: NULLABLE name: session_restored_mean @@ -1427,16 +1424,6 @@ name: value type: INTEGER mode: REPEATED - name: search_content_urlbar_persisted_sum - type: RECORD -- fields: - - mode: NULLABLE - name: key - type: STRING - - mode: NULLABLE - name: value - type: INTEGER - mode: REPEATED name: search_content_urlbar_searchmode_sum type: RECORD - fields: @@ -1557,16 +1544,6 @@ name: value type: INTEGER mode: REPEATED - name: search_withads_urlbar_persisted_sum - type: RECORD -- fields: - - mode: NULLABLE - name: key - type: STRING - - mode: NULLABLE - name: value - type: INTEGER - mode: REPEATED name: search_withads_urlbar_searchmode_sum type: RECORD - fields: @@ -1687,16 +1664,6 @@ name: value type: INTEGER mode: REPEATED - name: search_adclicks_urlbar_persisted_sum - type: RECORD -- fields: - - mode: NULLABLE - name: key - type: STRING - - mode: NULLABLE - name: value - type: INTEGER - mode: REPEATED name: search_adclicks_urlbar_searchmode_sum type: RECORD - fields: @@ -2029,12 +1996,6 @@ name: text_recognition_text_length_count_sum type: INTEGER - mode: NULLABLE - name: places_searchbar_cumulative_searches_sum - type: INTEGER -- mode: NULLABLE - name: places_searchbar_cumulative_filter_count_sum - type: INTEGER -- mode: NULLABLE name: scalar_parent_os_environment_launched_via_taskbar_private type: BOOLEAN - mode: NULLABLE @@ -2086,6 +2047,39 @@ name: logins_migrations_quantity_all type: INTEGER - mode: NULLABLE + name: search_count_urlbar_persisted + type: INTEGER +- fields: + - mode: NULLABLE + name: key + type: STRING + - mode: NULLABLE + name: value + type: INTEGER + mode: REPEATED + name: search_content_urlbar_persisted_sum + type: RECORD +- fields: + - mode: NULLABLE + name: key + type: STRING + - mode: NULLABLE + name: value + type: INTEGER + mode: REPEATED + name: search_withads_urlbar_persisted_sum + type: RECORD +- fields: + - mode: NULLABLE + name: key + type: STRING + - mode: NULLABLE + name: value + type: INTEGER + mode: REPEATED + name: search_adclicks_urlbar_persisted_sum + type: RECORD +- mode: NULLABLE name: media_play_time_ms_audio_sum type: INTEGER - mode: NULLABLE @@ -2231,6 +2225,12 @@ mode: REPEATED name: contextual_services_quicksuggest_impression_weather_sum type: RECORD +- mode: NULLABLE + name: places_searchbar_cumulative_searches_sum + type: INTEGER +- mode: NULLABLE + name: places_searchbar_cumulative_filter_count_sum + type: INTEGER - fields: - mode: NULLABLE name: key @@ -2342,3 +2342,7 @@ - name: startup_profile_selection_first_ping_only type: STRING mode: NULLABLE +- name: profile_group_id + type: STRING + mode: NULLABLE + description: A UUID identifying the profile's group on a single device and allowing user-oriented correlation of data ```

Link to full diff