cloudfour / lighthouse-parade

A Node.js command line tool that crawls a domain and gathers lighthouse performance data for every page.
MIT License
364 stars 14 forks source link

Differences between browser based Google Lighthouse performance & lighthouse-parade #135

Open mgifford opened 1 year ago

mgifford commented 1 year ago

I'm noticing a considerable difference between the score from Lighthouse Parade and from any of the pages in Google Lighthouse. I'm not sure why they would be different. It definitely decreases the credibility of the scan. I'm just using something like:

npx lighthouse-parade https://example.org/ ./lighthouse-parade-data --max-crawl-depth 3

calebeby commented 1 year ago

@mgifford I am wondering if it might have to do with lighthouse-parade using a different browser version and/or lighthouse version than the lighthouse in your browser. I know that the lighthouse team changes how they record scores between versions.

lighthouse-parade@2.1.0 uses lighthouse 9.5.0 lighthouse-parade@3.0.0-beta.2 uses lighthouse 9.6.2. The latest lighthouse version is 10.1.1, and I'll plan to update lighthouse before publishing the final version of lighthouse-parade@3.

I would guess that the version difference is probably a big factor in differences you might be seeing. If you're still seeing big differences after we get the lighthouse version in lighthouse-parade up to date, we can dig further into what might be causing differences.

mgifford commented 1 year ago

Good point.. And I might well want to ensure I'm upgrading to provide the latest of both libraries. They may be out of sync.

mgifford commented 1 year ago

I think I had installed this via NPM and was using the 2.x version of the code.

I also don't see the instructions to build from the next branch of the repo https://github.com/cloudfour/lighthouse-parade/tree/next

How do I install the script for the 3.x version of the code?

mgifford commented 1 year ago

See https://github.com/cloudfour/lighthouse-parade/issues/71#issuecomment-1528936325