Returning performance 0 (error) every time

GoogleChromeLabs / lighthousebot

Run Lighthouse in CI, as a web service, using Docker. Pass/Fail GH pull requests.

Apache License 2.0

2.24k stars 127 forks source link

Returning performance 0 (error) every time #56

Open balazsorban44 opened 5 years ago

balazsorban44 commented 5 years ago

When running lighthousebot on any of my PRs, Performance always is 0. Running it from Chrome Dev Tools, or from https://www.webpagetest.org/lighthouse, there is no such problem:

with lighthousebot on PR (flags --runner=wpt --pwa=100 --perf=77 --a11y=78 --bp=100 --seo=1):

WebPageTest:

Does CPU/Memory Power / Device emulation has anything to do with it? What should I do?

balazsorban44 commented 5 years ago

@ebidel ?

ebidel commented 5 years ago

Hmm, it looks like something is up with CPU never being idle on WPT. That's causing TTI to Error out and never calculated. I wonder what version of Lighthouse they're running and/or if something may have changed.

@brendankenny @paulirish have you seen this before?

balazsorban44 commented 5 years ago

@ebidel @brendankenny @paulirish Any news on this? 🤞