c4-project / c4t

Runs concurrent C compiler tests
MIT License
1 stars 0 forks source link

Rich status codes? #68

Open MattWindsor91 opened 3 years ago

MattWindsor91 commented 3 years ago

This issue explores one possible solution to #67, ie equipping the analyser with a more sophisticated notion of status from the basic flags

The analyser would calculate per-compiler statuses by scrutinising compiler logs and suchlike, and then merge them together. Much as happens now, but it'd stop being a simple flag union and be somewhat more sophisticated.

Possible ways to calculate overall status:

Saving under this regime would probably merge the overall and per-compiler status into the path, producing something like, iunno, us/run-fail+filtered, or maybe us/filtered/run-fail, etc.