search

GoogleChrome / lighthouse

Automated auditing, performance metrics, and best practices for the web.
https://developer.chrome.com/docs/lighthouse/overview/
Apache License 2.0
28.02k stars 9.32k forks source link

Unexpected changes on main thread work from 11.6.0 to 11.7.1 #15945

Closed mathdecastilho closed 1 month ago

mathdecastilho commented 2 months ago

I don't know if it is related to the issue: https://github.com/GoogleChrome/lighthouse/issues/15896#issue-2210370136

Summary My team noticed a change in our page's score (which was decreased) on CalibreApp (a Saas that uses lighthouse to daily check page performance), it just happened from one day to another. We investigated a lot and didn't find where this problem occurs in our code base. We also tried to roll back our app to an older version, from before the date that our score changed and it doesn't change it at all. Investigating more we found that Calibre just upgraded the Lighthouse (with Chrome) to version 11.7.1 and the day before was used 11.6.0 to generate the score. The main-thread working time is just taking twice as long as before. We decided to test using the CLI on a Macbook Air M1 16GB and noticed the same pattern, changing from 11.6.0 to 11.7.1. Here are some numbers:

Description 11.6.0 11.7.1
Lighthouse cli Screenshot 2024-04-15 at 14 19 06 Screenshot 2024-04-15 at 14 19 37
Lighhouse cli Screenshot 2024-04-15 at 14 19 24 Screenshot 2024-04-15 at 14 19 50
CalibreApp Screenshot 2024-04-15 at 14 23 43 Screenshot 2024-04-15 at 14 23 56

About our application: we use Vue 2, with Nuxt 2, in the latest version. If you want to test using our app, you can create a trial account: https://app.zazos.com/en

connorjclark commented 2 months ago

Can you double check your provided version numbers? Lighthouse is on 11.7.1

mathdecastilho commented 2 months ago

Can you double check your provided version numbers? Lighthouse is on 11.7.1

I'm sorry, it was a typo, I'm referring to versions 11.7.1 and 11.6.0

adamraine commented 2 months ago

Just running https://app.zazos.com/en using Lighthouse CLI locally doesn't produce a significant difference in TBT. Are you sure the Chrome version being used did not change as well?

That could be a contributing factor as seen in https://github.com/GoogleChrome/lighthouse/issues/15896

mathdecastilho commented 1 month ago

Update: The version 12.0.0 solves the problem. Thank you for the support! 🚀