search

mozilla-mobile / perf-frontend-issues

A repository to hold issues related to front-end mobile application performance.
4 stars 0 forks source link

Verify A51 is valid replacement for Moto G5 in nightly regression testing #235

Open mcomella opened 2 years ago

mcomella commented 2 years ago

We're migrating to the A51 as a low-end reference device. We should update our backfill.py regression testing system to use the A51. There are two phases:

  1. Update backfill.py to support A51 (and arm64)
  2. Compare results to Moto G5 to ensure it catches regressions well

This bug is for phase 2.

mcomella commented 2 years ago

We completed phase 1 https://github.com/mozilla-mobile/perf-frontend-issues/issues/234 and I briefly looked into this. Right off the bat, we see an issue where the data shows a sawtooth pattern. I filed https://github.com/mozilla-mobile/perf-frontend-issues/issues/236.