apertium / apertium-regtest

Regression testing system for Apertium language data and translators
https://wiki.apertium.org/wiki/Apertium-regtest
GNU General Public License v3.0
1 stars 0 forks source link

Alternate success threshold #8

Closed TinoDidriksen closed 2 years ago

TinoDidriksen commented 2 years ago

We often want nightly builds to succeed even if they aren't perfect. It would be nice with a way to set a different criteria for success. E.g., envvar AP_REGTEST_MIN=80 saying 80% is good enough to pass, with default value being 100.

Should also be settable as a cmdline parameter, but envvars are easier to use in many builds.