search

tastejs / hacker-news-pwas

HNPWA - Hacker News readers as Progressive Web Apps 📱
https://hnpwa.com
2.38k stars 206 forks source link

Automate WPT results periodically #71

Open housseindjirdeh opened 7 years ago

housseindjirdeh commented 7 years ago

This issue can track how we can eventually set up automated runs of WPT and extract results periodically. There's a Node wrapper for the API that looks handy.

Will love to hear everyone's thoughts on how we can do this 💃

addyosmani commented 7 years ago

I've been chatting about this with @ebidel who has been working on a CI story for Lighthouse with WebPageTest over in https://github.com/ebidel/lighthouse-ci/blob/master/frontend/lighthouse-ci.js#L75.

This might be something we can piggy back off :) He's working on some docs for a bit but maybe something we can look at in a week.

ebidel commented 7 years ago

Lighthouse CI docs are up!

Check out https://github.com/ebidel/lighthouse-ci#auditing-github-pull-requests and LMK if you run into issues. To run on WPT, you'll want to use --runner=wpt. Example output (the GH comment and pass/failing a PR): https://github.com/ebidel/chromium-dashboard/pull/6#issuecomment-307998005

FWIW, the CI only works on PRs events from Travis atm. But I'd love to know more about how you guys want to automate testing. For example, we could figure out ways to make the runlighthouse.js module work for than Travis setups. It's already fairly flexible.