search

ESMValGroup / ESMValTool

ESMValTool: A community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP
https://www.esmvaltool.org
Apache License 2.0
217 stars 127 forks source link

Create a workflow to test branches #1515

Open jvegreg opened 4 years ago

jvegreg commented 4 years ago

As for now, one of the most time consuming task is to test all recipes against any meaningful change we make on the core. We should create a workflow that automatises this, so we can just launch it and later check if it was successful or not.

We can use the Cylc installation is available on Jasmin for that but I don't know if we have it on DKRZ so we can test in both systems

I can help with this task, but it think we must discuss how we want to implement this during the workshop

Also, once we have it up and running, it will be easy to have it running once a week for continuous testing, with email notifications if something fails

mattiarighi commented 4 years ago

Related to #316

bjoernbroetz commented 4 years ago

As discussed in #1112 we will soon have a dedicated VM for this kind of testing at the DKRZ.

valeriupredoi commented 4 years ago

and while we're at it -> test_recipes_loading is taking a gazillion forevers and a half, we need to speed that thing up :beer:

bouweandela commented 4 years ago

Related to #1205