search

c4-project / c4f

The C4 Concurrent C Fuzzer
MIT License
14 stars 1 forks source link

User-friendly summary of memalloy run #22

Closed MattWindsor91 closed 5 years ago

MattWindsor91 commented 6 years ago

act currently just spits out a very large amount of S-expressions when herd, or some other part of the translation, fails. It's quite hard, from this, to find out what went wrong where.

It'd be nice if act printed out a little summary table at the end, something like:

Successes (1):

local.x86.clang.O3      test_6

Failures (3):

local.x86.gcc.normal    test_6  Herd failed
local.x86.gcc.O3        test_6  Compilation failed
local.x86.clang.normal  test_6  Behaviours didn't match

Unknown (2):

remote.arm.gcc.normal   ------  Compiler failed test
remote.arm.gcc.O3       ------  Disabled

This would probably be printed to stdout, while the detailed errors would continue to go to stderr.

MattWindsor91 commented 5 years ago

Recent commits have mostly sorted this, with some possible improvements that could be opened as new issues as and when.