search

DonggeLiu / Legion

A coverage-based software testing tool
MIT License
29 stars 4 forks source link

Do we need to use the `tbf-validator` to validate the results from `BenchExec`? #15

Closed DonggeLiu closed 4 years ago

DonggeLiu commented 4 years ago

I recall that we have been discussing about the tbf-testsuite-validator, but I also saw this from its GitHub page: image

Does this mean we no longer need to use the validator?

gernst commented 4 years ago

We need to use a validator to compute the coverage scores (for error discovery, I think we can trust our own code to detect these). There's a successor to tbf-testsuite-validator in the competition archives https://gitlab.com/sosy-lab/test-comp/archives-2020/-/tree/master/2020 now called val-testcov

DonggeLiu commented 4 years ago

The tool testcov requires a very specific format&path definition in its XML config. Adhering to such format solves the issue.