Any testing suite should have a special category for tests — ”known fails“. This category could be used for any known, but not yet fixed, issues (won'tfixes, minor minors) and for reporting bugs from community: people often send bugs as failing tests, but you can't merge the PRs in those cases as it would make your repo fail.
If there'd be a way to add tests that would be skipped on the normal run, but fail on the run with some key set, it would be really nice.
I wonder if it is already done somewhere.
Any testing suite should have a special category for tests — ”known fails“. This category could be used for any known, but not yet fixed, issues (won'tfixes, minor minors) and for reporting bugs from community: people often send bugs as failing tests, but you can't merge the PRs in those cases as it would make your repo fail.
If there'd be a way to add tests that would be skipped on the normal run, but fail on the run with some key set, it would be really nice.