search

gernst / legion-symcc

Fresh implementation of the Legion algorithm on top of SyMCC
Other
0 stars 1 forks source link

[TestComp-2022] `TestCov` Error that does not affect `LibKluzzer` #29

Open DonggeLiu opened 2 years ago

DonggeLiu commented 2 years ago

Issue

TestCov triggered an error when validating our inputs. However, it had no issue when validating the inputs from LibKluzzer on the same benchmark program.

Sample Output

From TestCov

DEBUG:root:Error output of execution:
2021-11-12 22:44:29,143 - INFO - Starting command ./output/a.out
2021-11-12 22:44:29,143 - INFO - Writing output to /tmp/testcov-odsj69_n/output.log and result files to .

DEBUG:root:No GCOV data file with known name found in directory: ['a.out', 'harness.c', 'info_files', 'testcov.log']
DEBUG:root:Falling back to look in current directory for GCDA file.
INFO:root:GCov coverage could not be computed: No GCOV data file with known name found in directory: ['lib', 'bin', 'LICENSES', 'README.md', 'LICENSE', 'harness.gcno', 'instrumented_id2_b5_o10.c', 'output']
DEBUG:root:No GCOV data file with known name found in directory: ['a.out', 'harness.c', 'info_files', 'testcov.log']
DEBUG:root:Falling back to look in current directory for GCDA file.
WARNING:root:Could not compute coverage for last test run: No GCOV data file with known name found in directory: ['lib', 'bin', 'LICENSES', 'README.md', 'LICENSE', 'harness.gcno', 'instrumented_id2_b5_o10.c', 'output']
DEBUG:root:Accumulated coverage: 0.0%
.
✔️  Done!
DEBUG:root:Can't reduce test suite because of missing coverage information
DEBUG:root:Copying bin/legion-symcc-qQyZunWU51/tests/id2_b5_o10/1.xml from ../../results-verified/legion-symcc.2021-11-12_21-14-45.files/Test-Comp22_coverage-branches.id2_b5_o10.yml/test-suite.zip to output/test-suite/bin/legion-symcc-qQyZunWU51/tests/id2_b5_o10/1.xml

---Results---
Tests run: 1
Coverage: 0%
Number of goals: 0
Result: DONE

From Legion-SymCC

Nothing strange, expect having an extremely long traces of output like:

? 0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 input: 55313f59
? 0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 input: 4ce0a77a
? 0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 input: 5721f136
? 0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 input: cf8b4470
? 0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 input: 155cb8ae
?

Command

./legion.sh -L ubuntu2004/lib -32 ../../sv-benchmarks/c/recursive-simple/id2_b3_o5.c

Sample programs

recursive-simple/id2_b3_o5.c recursive-simple/id_b2_o3.c and all other benchmarks from recursive-simple/id*