search

catapult-project / catapult

Deprecated Catapult GitHub. Please instead use http://crbug.com "Speed>Benchmarks" component for bugs and https://chromium.googlesource.com/catapult for downloading and editing source code..
https://chromium.googlesource.com/catapult
BSD 3-Clause "New" or "Revised" License
1.93k stars 563 forks source link

Make it easier to run Python/JS tests with less boilerplate #2097

Open eakuefner opened 8 years ago

eakuefner commented 8 years ago

This is related to #1962, but that's about the bot infrastructure side and this bug is about the developer workflow side.

In general, as we stand up new projects like Lighthouse and migrate libraries out to common/ (e.g. MRE, metric_runner), we need an easy way to run Python and JavaScript tests (devserver and vinn) without lots of boilerplate copypasta.

anniesullie commented 8 years ago

I started working on a doc around this. @eakuefner can you comment which boilerplate is highest priority to remove? https://docs.google.com/a/chromium.org/document/d/1r2e8ORmx6h-Kv1Pcq1F8-a4JdO5nFTRtzyKjqtt7l6U/edit?usp=sharing

eakuefner commented 8 years ago

I don't care so much about duplicating the scripts in the project bin/ directories if that needs to be done. Brainstorming a bit, the journeys I wonder about are:

  1. How to set up the dev server config for a new project
  2. How to add the link to //bin/run_dev_server
  3. How to stand up Python unittests with only minimal background knowledge of typ
  4. How to deploy tests on the waterfall without touching recipes directly.