Commits cause spam

[hanjoosten]

Sometimes I get spammed by some RAP test, triggered by a commit on RAP. Here is an example of the spam caused by a commit: https://github.com/AmpersandTarski/RAP/commit/5a2d6c66962d85f9f61a00a5b83a7834f949f85f#commitcomment-123678988

As you can see, there is a live test going on, and some of them fail. There is no follow-up on failed tests, I guess. That cannot be OK.

In this issue, I would like the following to be researched and documented:

• What triggers the test?
• What is being tested?
• Why is this test triggered so often, Where can that be configured?
• Is there a more effective way to get the attention when a test fails?

[stefjoosten]

Let's pick this up when the A-team has test capacity. However, we need to think about the test strategy first.