mozilla / glam

Mozilla's primary interactive dashboard for examining the distribution of telemetry values.
https://glam.telemetry.mozilla.org
Mozilla Public License 2.0
21 stars 23 forks source link

ETL and import for Firefox Desktop on Glean (FOG) probes #1559

Closed robhudson closed 2 years ago

robhudson commented 3 years ago

Telemetry based firefox desktop and FoG will have separate ETL pipelines. Ideally we keep the data separate as far as we can into GLAM, which means separate metrics in probe-search and separate aggregation tables in GLAM.

We propose that it would be best to have a unified search experience rather than a separate top level product pull-down for both.

This issue is to research how we can search both probe-search tables and pass the relevant data to the metric that is chosen so it gets directed to the right data.

rafrombrc commented 2 years ago

ETL is done, we've now got GLAM data sets with the Firefox Desktop Glean probes in them, and files sitting in GCS ready to be picked up by the importer. Next step is importing these into CloudSQL.

alekhyamoz commented 2 years ago

ETL is done. Import being tracked in #1737