search

intel / yarpgen

Yet Another Random Program Generator
Other
484 stars 53 forks source link

while I ran 'run_gen.py --no-tmp-cleaner -o ./test --target gcc' on a linux machine #164

Closed Codymap closed 1 year ago

Codymap commented 2 years ago

while I ran 'run_gen.py --no-tmp-cleaner -o ./test --target gcc' on a linux machine, I still cannt get ok TC files saving , there only have compfail and runfail in /test/result/gcc. Can I get the files which status are ok?

Vsevolod-Livinskij commented 2 years ago

It is not a typical application case, so run_gen.py doesn't support this by default.

The easiest way to get them is to use a workaround.

  1. Generate random seeds (64-bit positive number) and write them to a file (e.g., seeds.txt). They have to be separated by a space or a new line
  2. Pass them to run_gen.py to test which are correct: ./run_gen.py --seeds seeds.txt
  3. The failed seeds will be stored in the testing/result directory and printed at the end of the execution of run_gen.py under FAILED SEEDS section
  4. Exclude failed seeds from the seeds.txt file. After that, the remaining seeds will correspond to tests that don't trigger a compiler error
  5. For each of them, use yarpgen (the binary can be found at the top of the build directory) to generate a test: ./yarpgen -s YYY. You can also tell it to save files to a pre-existing folder with -o argument: ./yarpgen -s YYY -o YYY

Please let me know if the suggested solution doesn't work or if you have any other questions.

Codymap commented 2 years ago

Thank you very much ! This is very helpful for me, the problem has be solved.