mozilla / jetstream

This machine kills superstition. đŸ’¨
https://experimenter.info/jetstream/jetstream
Mozilla Public License 2.0
22 stars 18 forks source link

Ad Clicks section of enrollments dashboard is broken #1750

Open danielkberry opened 1 year ago

danielkberry commented 1 year ago

For example: https://mozilla.cloud.looker.com/dashboards/216?Experiment=persist-search-term-rollout-phase-1&Time%20Range%20%5BUTC%5D=28%20day. CC @pissac17

┆Issue is synchronized with this Jira Task

scholtzan commented 1 year ago

Did anything change in how we report ad clicks? Checking the stable tables for this (and some other experiments), payload.processes.parent.keyed_scalars.browser_search_with_ads and payload.processes.parent.keyed_scalars.browser_search_ad_clicks are mainly NULL: https://sql.telemetry.mozilla.org/queries/92242

So the dashboard isn't broken, it shows the correct data, but it seems something further down the pipeline (on the client??) might be

danielkberry commented 1 year ago

@mmccorks I think I recalled we talked about this issue a bit? Do you have anything to add?

danielkberry commented 1 year ago

I got "The experiment monitoring dashboards are also using the old version of the ad clicks and search with ads probes - we should update these to pull from the new versions of these probes instead." from this ticket. I'm not sure yet what the new, corrected values are.