code-pushup / cli

A CLI to run all kinds of code quality measurements to align your team with company goals
https://code-pushup.dev
MIT License
202 stars 11 forks source link

Flaky Lighthouse plugin - `Unable to connect to Chrome` #538

Open Tlacenka opened 6 months ago

Tlacenka commented 6 months ago

What happened?

Sometimes running the Code PushUp fails for the Lighthouse plugin due to a refused connection to Chrome.

What would you expect to happen?

The pipelines are stable.

What steps did you take?

I opened a PR which executed the CI pipeline along with the Code PushUp step.

Code PushUp package version

0.25.2

What operation system are you on?

Linux

Node version

18.18.2

Relevant log output

Pipeline run here.

vmasek commented 5 months ago

related to #549

matejchalk commented 5 months ago

@BioPhoton Happened 3 times in a row for me just now 😞 https://github.com/code-pushup/cli/actions/runs/8440023209/job/23116293386

BioPhoton commented 5 months ago

I added a trouble shooting guide to the lighthouse plugin. This should enable to fix it.

BioPhoton commented 2 months ago

I would close this one for now as a time increase and reduction of audits made it pretty stable

vmasek commented 1 month ago

Related to "unable to connect to Chrome" error, will reopen on re-occurrence in future

matejchalk commented 1 month ago

@BioPhoton It reocurred for our latest commit 😅 https://github.com/code-pushup/cli/actions/runs/9959791924/job/27517455858#step:6:580 So definitely not solved, re-opening 🐞

matejchalk commented 1 month ago

2 more occurrences today (both on Windows, both passed after retry):

matejchalk commented 1 month ago

2 more occurrences today, both in Windows, seems to be a strong pattern:

matejchalk commented 1 month ago

Happened again today, this time on Ubuntu (passed after retry):