search

mozilla / glam

Mozilla's primary interactive dashboard for examining the distribution of telemetry values.
https://glam.telemetry.mozilla.org
Mozilla Public License 2.0
20 stars 23 forks source link

Filter out undesired metrics / probes #2695

Closed edugfilho closed 4 months ago

edugfilho commented 5 months ago

The current filter on the public tables is

  -- filter based on https://github.com/mozilla/python_mozaggregator/blob/6c0119bfd0b535346c37cb3f707d998039d3e24b/mozaggregator/service.py#L51
  (
    metric NOT LIKE r"%search\_counts%"
    AND metric NOT LIKE r"%browser\_search%"
    AND metric NOT LIKE r"%event\_counts%"
    AND metric NOT LIKE r"%browser\_engagement\_navigation%"
    AND metric NOT LIKE r"%manager\_message\_size%"
    AND metric NOT LIKE r"%dropped\_frames\_proportion%"
edugfilho commented 4 months ago

We are going to filter out undesired metrics by using a view on top of the datasets and have GLAM read from those views: https://github.com/mozilla/bigquery-etl/pull/5025/files#diff-fb35571f828bc9e516262263e6c0b7c83bbc2214b0374cb60c7a29d1d33fd8ee