GoogleChrome / lighthouse-ci

Automate running Lighthouse for every commit, viewing the changes, and preventing regressions
Apache License 2.0
6.34k stars 635 forks source link

Performance metrics difference between lhci server vs chrome devtools #876

Open Ramya412 opened 1 year ago

Ramya412 commented 1 year ago

I could see the difference between devtool vs our lighthouse server's performance metrics. Performance looks always high when the reports are generated from our server when compared to devtools and few of the audits under performance are also missing We have launched the lighthouse server with reference to the below docker recipe document https://github.com/GoogleChrome/lighthouse-ci/tree/main/docs/recipes/docker-server

The major difference I could see between these two reports are.. our lighthouse server is generating reports from 9.3.0 version and axe version is 4.3.5

Where as the reports which are generated via devtool has below versions Lighthouse 9.6.8 Axe version 4.4.1 Chrome version looks same in both reports Throttling is selected as simulate

Please note we are using the latest lhci version 0.10.0 and lighthouse 10.0.0 npm packages are installed.

Node version 16.17.0 Npm version 8.15.0

The version difference is causing this mismatch in the performance metrics?? If yes how can I How can I upgrade the lighthouse and axe versions in our lighthouse server?