iiasa / message_ix

The integrated assessment and energy systems model MESSAGEix
https://docs.messageix.org
Apache License 2.0
112 stars 149 forks source link

Split tutorial tests to separate CI job #739

Closed khaeru closed 5 months ago

khaeru commented 10 months ago

The "pytest" CI workflow takes up to 20 minutes (Windows) to run, which makes it less useful for its intended purpose of quick feedback on PRs. Most of the 20 longest-duration tests are tutorial tests.

One way to address this:

Other benefits: we could upload Codecov reports for only the "pytest" workflow. This would help us see if there is any code that is currently tested only through its use in a tutorial, and add more direct (faster, simpler) tests.

glatterf42 commented 10 months ago

Thanks for adding this issue, this sounds like a helpful improvement.