search

vermaseren / form

The FORM project for symbolic manipulation of very big expressions
GNU General Public License v3.0
982 stars 118 forks source link

[ci] Split long running test jobs #319

Open tueda opened 4 years ago

tueda commented 4 years ago

Currently, the execution time of test jobs in CI is unbalanced. For example, in this build, the job

CI_TARGET=valgrind-parvorm TEST=examples.frm

took 27 minutes, in which running test cases spent 20 minutes. Typically, this job (or CI_TARGET=valgrind-parvorm TEST=fixes.frm) remains running in the end of the whole set. Because it seems that 4 jobs can concurrently run on Travis CI, splitting it further may make the total CI time shorter.

Perhaps, in a spirit of pytest-split-tests, it could be split into

CI_TARGET=valgrind-parvorm TEST=examples.frm TEST_GROUP=1/2
CI_TARGET=valgrind-parvorm TEST=examples.frm TEST_GROUP=2/2

The same for CI_TARGET=valgrind-parvorm TEST=fixes.frm.