mozilla-mobile / perf-frontend-issues

A repository to hold issues related to front-end mobile application performance.
4 stars 0 forks source link

Get fennec cold applink measurement from FNPRMS #59

Closed mcomella closed 4 years ago

mcomella commented 4 years ago

We're currently getting our weekly cold applink to about:blank numbers via manual runs of our "prelim" measurement system. afaik, this is because:

We should get a baseline measurement of Fennec cold applink from FNPRMS so we can monitor FNPRMS Fenix Nightly for cold applink performance changes.

hawkinsw commented 4 years ago

Using the latest code from FNPRMS that makes manual measurement easier, here are some results for the AL cases:

  1. Fenix (nightly, January 10, 2020): 599ms
  2. Fennec (68): 511ms

For a delta of 17.2%.

These two numbers are comparable in so far as they both reflect Android's Display time. The caveat is that they may not be comparable in terms of user-perceived startup times. See, e.g., the open issues for better understanding Display time and the asynchronicity of Fennec's startup UI rendering.

mcomella commented 4 years ago

lgtm and I passed this info on to @pslawless. I'm going to close as Done and we can reopen if pslawless has issues.