Sudden increase of WPT Tests with no Start Render reported on multiple domains

catchpoint / WebPageTest

Official repository for WebPageTest

Other

3.08k stars 715 forks source link

Sudden increase of WPT Tests with no Start Render reported on multiple domains #1323

Closed gilbertococchi closed 5 months ago

gilbertococchi commented 4 years ago

Hi all, since mi Dec 2019 tests complete correctly but randomly shows Error Code 99999 with some metrics reported as 0 and others with values.

Here's an example: https://webpagetest.org/result/200109_QK_05921c4ff14c62c36d9584237164ffcc/1/details/#waterfall_view_step1

It seems like SpeedIndex, Start Render and Visually Complete Time metrics fail to compute while others may. Any idea what is going on here?

pmeenan commented 4 years ago

99999 is a successful page load but with content errors. In this specific case, https://www.lastampa.it/.well-known/pubvendors.json is returning a 404

gilbertococchi commented 4 years ago

Hi Patrick, thanks for your answer, ok so maybe the 404 is not the reason of the missing metrics here.

Because on the Run2 there is still the 404 but the Speed Index Metrics worked: https://webpagetest.org/result/200109_QK_05921c4ff14c62c36d9584237164ffcc/2/details/#waterfall_view_step1

It's not the case on Run 1: https://webpagetest.org/result/200109_QK_05921c4ff14c62c36d9584237164ffcc/1/details/#waterfall_view_step1

Can you please advice where I can look up for errors that might case WPT to not showing Start Render, Speed Index and Visually Complete results?

I see this happening randomly on the same URL with no apparent reason.

I will try to dig more on the trace to find out more...

pmeenan commented 4 years ago

For whatever reason, the page didn't render anything before the end of the test so no times could be calculated. If you go to the filmstrip view you'll be able to see the white frames which is all that got recorded.

gilbertococchi commented 4 years ago

Thanks Patrick, can you please point me to some logs where I can dig on the reason?

This is happening randomly on many different domains etc I am testing via WPT API and I don't believe the issue is on the site itself, I suspect some Chromium change or some bug...

pmeenan commented 4 years ago

if you pass keepvideo=1 as a test option then the raw video of the device loading the page will be captured so you can see if it was a processing issue or a content issue.

Beyond that requires capturing chrome traces with a bunch of categories and investigating each page (by someone who knows how the pages work).

github-actions[bot] commented 5 months ago

We're in the process of cleaning up issues on this project in order to ensure we're able to stay on top of high priority bugs and feature requests. As a part of this process, we're automatically closing any issues that have had no activity within the last two years, including this one, since the codebase has changed dramatically in that time. If you feel this is still relevant, please file a new issue using the relevant issue template so we can get it prioritized. Thanks!