search

mozilla / missioncontrol

Real-time monitoring of Firefox release health
Mozilla Public License 2.0
21 stars 18 forks source link

Add frontend option to filter out anomalous data points #112

Closed wlach closed 7 years ago

wlach commented 7 years ago

Sometimes we get strange results on a single 5-minute interval. Plotting these results on the graphs makes it hard to see what the overall trend is because they seriously distort the scale:

screen shot 2017-08-14 at 5 38 32 pm

Easy fix for this would be to use a median filter on the results client side. We could make this a togglable option, in the same way as we normalize counts by usage hours.

@maurodoglio -- do you want to try your hand on this one (probably makes sense to do so after #108 is merged)? This would make a good introduction to modifying the react-based frontend. Most/all of the changes should be here: https://github.com/mozilla/missioncontrol/blob/master/frontend/ui/detailview.jsx

wlach commented 7 years ago

I have been working on this, as it's basically a blocker to being able to interpret some measures. Will file PR tomorrow.

I will find some other smaller tasks for the frontend for mauro or anyone else who's interested soon. :)

wlach commented 7 years ago

So this sort of works, except that some spikes seem to sustain themselves, so the problem remains (usually in a slightly less pronounced form).

I think adding a percentile filter (which just outright removes values not within a specific range) might be a better strategy for dealing with this issue. Gonna try that.

wlach commented 7 years ago

Pretty happy with the percentile solution I landed in #147.