search

squaresLab / ManyBugs

16 stars 7 forks source link

gmp:14166-14167 test cases assumed failed #14

Open Dearth opened 6 years ago

Dearth commented 6 years ago

Hello,

I am attempting to recreate a couple of the previously reported repairs on gmp:14166-14167 by running genprog with the previously defined --seed. However, when I run genprog configuration-default, genprog completes its sanity check, and coverage, but starts to report

cachingRep: test_cases: wait: Not_found cachingRep: test_cases: p1 assumed failed cachingRep: test_cases: p2 assumed failed

for each positive test when evaluating the individuals in a population. Genprog also reports a fitness of 1 next to each genome string. I am assuming this is unexpected behavior, is there a known fix?

My current working configuration is:

--multi-file --search ga --compiler-command ./compile.sh EXE_NAME > /dev/null --test-command TEST_SCRIPT __TEST_NAME__ >& /dev/null --crossover subset --rep cilpatch --suffix-extension .c --describe-machine --pos-tests 144 --neg-tests 1 --program manifest.txt --prefix preprocessed --seed 4 --test-script ./test.sh --popsize 40 --generations 10 --promut 1 --mutp 0 --fitness-in-parallel 2 --rep-cache default.cache --skip-failed-sanity-check

Thanks for your time.

Dearth commented 6 years ago

Quick update, I found gmp-14166-14167 can be run without errors if 1) --skip-failed-sanity-test is on 2) --fitness-in-parallel 2 is removed from the configuration.

Not sure if that is a good fix but it seems to be working so far.