abelsiqueira
commented
20 hours ago This should be an option, indeed. The rationale is faster development based on the Tulipa project, where running on 1.6+Windows was taking ~2x than latest+Ubuntu. I've also had requests to run the TestOnPRs on a matrix, and let the user decide the matrix (which is a bit harder with a template, but feasible with manual intervention).
Description
In the current setup, two yaml files to run CI tests are generated
Test.yml: Runs on multiple OSs and julia versions (assuming the user chooses to do so of course)TestOnPRs.yml: only runs on latest julia version and ubuntu (even if user selects multiple OSs and julia versions)What is the rationale for this choice?
To me, would make more sense to run the whole matrix both on main and on PR. The motivation for this is that if a PR introduces an OS-dependent problem (for example, it's not rare for packages using wrappers of C-libraries to fail only on windows) I would prefer to catch this before merging the PR to main.