search

mozilla / probe-scraper

Scrape and publish Telemetry probe data from Firefox
https://mozilla.github.io/probe-scraper/
Mozilla Public License 2.0
21 stars 53 forks source link

Bug 1873431 - Add TikTok Reporter apps (iOS and Android) #675

Closed travis79 closed 8 months ago

travis79 commented 8 months ago

This is blocked on the feature branch in the iOS version of the TikTok Reporter with the metrics.yaml and pings.yaml files being merged into the main branch. Once that's done, I'll need to perform another dry-run and this should be good to go.

travis79 commented 8 months ago

Feature branch has landed in the iOS repo, so marking this as ready-to-review now. Final dry run was successful:

dry-run output:

➜  probe-scraper git:(Bug1873431) ✗ ./venv/bin/python3 -m probe_scraper.runner --dry-run --cache-dir tmp/cache --out-dir tmp/out --glean --glean-repo tiktokreporter-android --glean-repo firefox_ios --glean-repo fenix --glean-repo tiktokreporter-ios
Unable to parse whitelist (/Users/travislong/Repos/probe-scraper/probe_scraper/parsers/third_party/histogram-whitelists.json). Assuming all histograms are acceptable.
Getting commits for repository fenix
Pulling commits into tmp/cache/mozilla-mobile/firefox-android.git
  Got 500 commits
Getting commits for repository tiktokreporter-ios
Pulling commits into tmp/cache/MozillaFoundation/tiktok-reporter-app-ios.git
  Got 5 commits
Getting commits for repository tiktokreporter-android
Pulling commits into tmp/cache/MozillaFoundation/tiktok-reporter-app-android.git
  Got 8 commits

writing output:
  tmp/out/glean/fenix/dependencies
  tmp/out/glean/tiktokreporter-ios/dependencies
  tmp/out/glean/tiktokreporter-android/dependencies
  tmp/out/glean/fenix/general
  tmp/out/glean/tiktokreporter-ios/general
  tmp/out/glean/tiktokreporter-android/general
  tmp/out/glean/glean-core/pings
  tmp/out/glean/glean-android/pings
  tmp/out/glean/lib-crash/pings
  tmp/out/glean/sync/pings
  tmp/out/glean/engine-gecko/pings
  tmp/out/glean/engine-gecko-beta/pings
  tmp/out/glean/engine-gecko-nightly/pings
  tmp/out/glean/logins-store/pings
  tmp/out/glean/fxa-client/pings
  tmp/out/glean/support-migration/pings
  tmp/out/glean/android-places/pings
  tmp/out/glean/glean-js/pings
  tmp/out/glean/nimbus/pings
  tmp/out/glean/nimbus-cirrus/pings
  tmp/out/glean/gecko/pings
  tmp/out/glean/firefox-desktop/pings
  tmp/out/glean/firefox-desktop-background-update/pings
  tmp/out/glean/firefox-desktop-background-defaultagent/pings
  tmp/out/glean/pine/pings
  tmp/out/glean/firefox-android-release/pings
  tmp/out/glean/firefox-android-beta/pings
  tmp/out/glean/fenix/pings
  tmp/out/glean/fenix-nightly/pings
  tmp/out/glean/firefox-android-nightly/pings
  tmp/out/glean/firefox-ios-release/pings
  tmp/out/glean/firefox-ios-beta/pings
  tmp/out/glean/firefox-ios-dev/pings
  tmp/out/glean/reference-browser/pings
  tmp/out/glean/firefox-for-fire-tv/pings
  tmp/out/glean/firefox-reality/pings
  tmp/out/glean/lockwise-android/pings
  tmp/out/glean/lockwise-ios/pings
  tmp/out/glean/mozregression/pings
  tmp/out/glean/burnham/pings
  tmp/out/glean/mozphab/pings
  tmp/out/glean/firefox-for-echo-show/pings
  tmp/out/glean/firefox-reality-pc/pings
  tmp/out/glean/mach/pings
  tmp/out/glean/firefox-focus-ios/pings
  tmp/out/glean/firefox-klar-ios/pings
  tmp/out/glean/firefox-focus-android/pings
  tmp/out/glean/firefox-focus-android-beta/pings
  tmp/out/glean/firefox-focus-android-nightly/pings
  tmp/out/glean/firefox-klar-android/pings
  tmp/out/glean/bergamot/pings
  tmp/out/glean/firefox-translations/pings
  tmp/out/glean/rally-debug/pings
  tmp/out/glean/rally-core/pings
  tmp/out/glean/mozilla-vpn/pings
  tmp/out/glean/mozilla-vpn-android/pings
  tmp/out/glean/mozilla-vpn-ios/pings
  tmp/out/glean/mozilla-vpn-ios-network-ext/pings
  tmp/out/glean/mozillavpn-backend-cirrus/pings
  tmp/out/glean/rally-study-zero-one/pings
  tmp/out/glean/mlhackweek-search/pings
  tmp/out/glean/regrets-reporter-ucs/pings
  tmp/out/glean/rally-markup-fb-pixel-hunt/pings
  tmp/out/glean/glean-dictionary/pings
  tmp/out/glean/mdn-yari/pings
  tmp/out/glean/rally-citp-search-engine-usage/pings
  tmp/out/glean/bedrock/pings
  tmp/out/glean/rally-attention-stream/pings
  tmp/out/glean/viu-politica/pings
  tmp/out/glean/treeherder/pings
  tmp/out/glean/firefox-desktop-background-tasks/pings
  tmp/out/glean/accounts-frontend/pings
  tmp/out/glean/accounts-backend/pings
  tmp/out/glean/monitor-cirrus/pings
  tmp/out/glean/debug-ping-view/pings
  tmp/out/glean/monitor-frontend/pings
  tmp/out/glean/moso-mastodon-backend/pings
  tmp/out/glean/moso-mastodon-web/pings
  tmp/out/glean/tiktokreporter-ios/pings
  tmp/out/glean/tiktokreporter-android/pings
  tmp/out/glean/glean-core/tags
  tmp/out/glean/glean-android/tags
  tmp/out/glean/lib-crash/tags
  tmp/out/glean/sync/tags
  tmp/out/glean/engine-gecko/tags
  tmp/out/glean/engine-gecko-beta/tags
  tmp/out/glean/engine-gecko-nightly/tags
  tmp/out/glean/logins-store/tags
  tmp/out/glean/fxa-client/tags
  tmp/out/glean/support-migration/tags
  tmp/out/glean/android-places/tags
  tmp/out/glean/glean-js/tags
  tmp/out/glean/nimbus/tags
  tmp/out/glean/nimbus-cirrus/tags
  tmp/out/glean/gecko/tags
  tmp/out/glean/firefox-desktop/tags
  tmp/out/glean/firefox-desktop-background-update/tags
  tmp/out/glean/firefox-desktop-background-defaultagent/tags
  tmp/out/glean/pine/tags
  tmp/out/glean/firefox-android-release/tags
  tmp/out/glean/firefox-android-beta/tags
  tmp/out/glean/fenix/tags
  tmp/out/glean/fenix-nightly/tags
  tmp/out/glean/firefox-android-nightly/tags
  tmp/out/glean/firefox-ios-release/tags
  tmp/out/glean/firefox-ios-beta/tags
  tmp/out/glean/firefox-ios-dev/tags
  tmp/out/glean/reference-browser/tags
  tmp/out/glean/firefox-for-fire-tv/tags
  tmp/out/glean/firefox-reality/tags
  tmp/out/glean/lockwise-android/tags
  tmp/out/glean/lockwise-ios/tags
  tmp/out/glean/mozregression/tags
  tmp/out/glean/burnham/tags
  tmp/out/glean/mozphab/tags
  tmp/out/glean/firefox-for-echo-show/tags
  tmp/out/glean/firefox-reality-pc/tags
  tmp/out/glean/mach/tags
  tmp/out/glean/firefox-focus-ios/tags
  tmp/out/glean/firefox-klar-ios/tags
  tmp/out/glean/firefox-focus-android/tags
  tmp/out/glean/firefox-focus-android-beta/tags
  tmp/out/glean/firefox-focus-android-nightly/tags
  tmp/out/glean/firefox-klar-android/tags
  tmp/out/glean/bergamot/tags
  tmp/out/glean/firefox-translations/tags
  tmp/out/glean/rally-debug/tags
  tmp/out/glean/rally-core/tags
  tmp/out/glean/mozilla-vpn/tags
  tmp/out/glean/mozilla-vpn-android/tags
  tmp/out/glean/mozilla-vpn-ios/tags
  tmp/out/glean/mozilla-vpn-ios-network-ext/tags
  tmp/out/glean/mozillavpn-backend-cirrus/tags
  tmp/out/glean/rally-study-zero-one/tags
  tmp/out/glean/mlhackweek-search/tags
  tmp/out/glean/regrets-reporter-ucs/tags
  tmp/out/glean/rally-markup-fb-pixel-hunt/tags
  tmp/out/glean/glean-dictionary/tags
  tmp/out/glean/mdn-yari/tags
  tmp/out/glean/rally-citp-search-engine-usage/tags
  tmp/out/glean/bedrock/tags
  tmp/out/glean/rally-attention-stream/tags
  tmp/out/glean/viu-politica/tags
  tmp/out/glean/treeherder/tags
  tmp/out/glean/firefox-desktop-background-tasks/tags
  tmp/out/glean/accounts-frontend/tags
  tmp/out/glean/accounts-backend/tags
  tmp/out/glean/monitor-cirrus/tags
  tmp/out/glean/debug-ping-view/tags
  tmp/out/glean/monitor-frontend/tags
  tmp/out/glean/moso-mastodon-backend/tags
  tmp/out/glean/moso-mastodon-web/tags
  tmp/out/glean/tiktokreporter-ios/tags
  tmp/out/glean/tiktokreporter-android/tags
  tmp/out/glean/glean-core/metrics
  tmp/out/glean/glean-android/metrics
  tmp/out/glean/lib-crash/metrics
  tmp/out/glean/sync/metrics
  tmp/out/glean/engine-gecko/metrics
  tmp/out/glean/engine-gecko-beta/metrics
  tmp/out/glean/engine-gecko-nightly/metrics
  tmp/out/glean/logins-store/metrics
  tmp/out/glean/fxa-client/metrics
  tmp/out/glean/support-migration/metrics
  tmp/out/glean/android-places/metrics
  tmp/out/glean/glean-js/metrics
  tmp/out/glean/nimbus/metrics
  tmp/out/glean/nimbus-cirrus/metrics
  tmp/out/glean/gecko/metrics
  tmp/out/glean/firefox-desktop/metrics
  tmp/out/glean/firefox-desktop-background-update/metrics
  tmp/out/glean/firefox-desktop-background-defaultagent/metrics
  tmp/out/glean/pine/metrics
  tmp/out/glean/firefox-android-release/metrics
  tmp/out/glean/firefox-android-beta/metrics
  tmp/out/glean/fenix/metrics
  tmp/out/glean/fenix-nightly/metrics
  tmp/out/glean/firefox-android-nightly/metrics
  tmp/out/glean/firefox-ios-release/metrics
  tmp/out/glean/firefox-ios-beta/metrics
  tmp/out/glean/firefox-ios-dev/metrics
  tmp/out/glean/reference-browser/metrics
  tmp/out/glean/firefox-for-fire-tv/metrics
  tmp/out/glean/firefox-reality/metrics
  tmp/out/glean/lockwise-android/metrics
  tmp/out/glean/lockwise-ios/metrics
  tmp/out/glean/mozregression/metrics
  tmp/out/glean/burnham/metrics
  tmp/out/glean/mozphab/metrics
  tmp/out/glean/firefox-for-echo-show/metrics
  tmp/out/glean/firefox-reality-pc/metrics
  tmp/out/glean/mach/metrics
  tmp/out/glean/firefox-focus-ios/metrics
  tmp/out/glean/firefox-klar-ios/metrics
  tmp/out/glean/firefox-focus-android/metrics
  tmp/out/glean/firefox-focus-android-beta/metrics
  tmp/out/glean/firefox-focus-android-nightly/metrics
  tmp/out/glean/firefox-klar-android/metrics
  tmp/out/glean/bergamot/metrics
  tmp/out/glean/firefox-translations/metrics
  tmp/out/glean/rally-debug/metrics
  tmp/out/glean/rally-core/metrics
  tmp/out/glean/mozilla-vpn/metrics
  tmp/out/glean/mozilla-vpn-android/metrics
  tmp/out/glean/mozilla-vpn-ios/metrics
  tmp/out/glean/mozilla-vpn-ios-network-ext/metrics
  tmp/out/glean/mozillavpn-backend-cirrus/metrics
  tmp/out/glean/rally-study-zero-one/metrics
  tmp/out/glean/mlhackweek-search/metrics
  tmp/out/glean/regrets-reporter-ucs/metrics
  tmp/out/glean/rally-markup-fb-pixel-hunt/metrics
  tmp/out/glean/glean-dictionary/metrics
  tmp/out/glean/mdn-yari/metrics
  tmp/out/glean/rally-citp-search-engine-usage/metrics
  tmp/out/glean/bedrock/metrics
  tmp/out/glean/rally-attention-stream/metrics
  tmp/out/glean/viu-politica/metrics
  tmp/out/glean/treeherder/metrics
  tmp/out/glean/firefox-desktop-background-tasks/metrics
  tmp/out/glean/accounts-frontend/metrics
  tmp/out/glean/accounts-backend/metrics
  tmp/out/glean/monitor-cirrus/metrics
  tmp/out/glean/debug-ping-view/metrics
  tmp/out/glean/monitor-frontend/metrics
  tmp/out/glean/moso-mastodon-backend/metrics
  tmp/out/glean/moso-mastodon-web/metrics
  tmp/out/glean/tiktokreporter-ios/metrics
  tmp/out/glean/tiktokreporter-android/metrics
  tmp/out/glean/repositories
  tmp/out/general
  tmp/out/v2/glean/app-listings
  tmp/out/v2/glean/library-variants
travis79 commented 8 months ago

Fixed a couple of linting issues, dry-run looks good, I think this is ready to r?