search

sitespeedio / browsertime

Measure and Optimize Web Performance
https://www.sitespeed.io/documentation/browsertime/
Apache License 2.0
608 stars 137 forks source link

Firefox on Moto G5 have 0 visual metrics for https://www.wikipedia.org #2178

Open soulgalore opened 1 month ago

soulgalore commented 1 month ago

Something is broken when you run default settings for Firefox (130) on a Moto G5. I've verified this on my Mac and a Raspberry Pi with a Moto G5 connected.

I've tested in using sitespeed.io but should be the same in browsertime: bin/sitespeed.js https://www.wikipedia.org -n 1 -o --android --video --visualMetrics -b firefox

https://github.com/user-attachments/assets/944712d3-b548-4cfc-9789-dfbf5dd7e125

When test using Chrome it works.

soulgalore commented 1 month ago

I can only reoproduce this when testing https://www.wikipedia.org. If I change the pageCompleteCheck to listen for networks activity, the metrics are correct. Maybe the test/video ends too early? Yes tit does.

https://github.com/user-attachments/assets/511285b1-36d1-49cb-9e28-abe259d4d384

By default we should wait for the loadEventEnd + 2 seconds but it seems like something changed in Firefox?

soulgalore commented 1 month ago

Hmm, I cannot reproduce this running through Browsertime, that is strange.