search

paulirish / pwmetrics

Progressive web metrics at your fingertipz
Apache License 2.0
1.25k stars 74 forks source link

Comparing measurements between headless and none headless modes for perf metrics #151

Closed denar90 closed 6 years ago

denar90 commented 6 years ago

As @paulirish mentioned there is no proof to be sure that metrics got from headless and none headless modes the same.

So I've done some experiments, running 15 times in default and 15 in headless mode. Results are pretty the same:

image

pedro93 commented 6 years ago

Great ideia, we should tdo his kind of investigation more often! I have some questions about the results though, they don’t make much sense to me in the spreadsheet I only see 21 runs, where’s the rest? Which ones are headless and which aren’t?

denar90 commented 6 years ago

sorry, I've played a bit with diagrams, now it's restored. here's better screenshot image