google / fuzzbench

FuzzBench - Fuzzer benchmarking as a service.
https://google.github.io/fuzzbench/
Apache License 2.0
1.09k stars 264 forks source link

Wrong categorization for eclipser? #1228

Open Strafo opened 3 years ago

Strafo commented 3 years ago

Hi, I was comparing the fuzzers categorized as "Binary-only" listed in the workflows / fuzzers.yml file. From the results of my local experiment, I believe that eclipser has an excessive advantage over the other fuzzers. I think the big advantage is that, compared to other "binary-only" fuzzers, eclipser runs alongside AFL not in qemu-mode. So I was wondering if it was more appropriate to move eclipser under the label "concolic execution" and add a new fuzzer eclipser_afl_qemu under "binary-only".

jonathanmetzman commented 3 years ago

Good eye. Yes this makes sense. Previously eclipser did not use AFL and was in fact binary-only, but now it is not. Would you like to submit a PR to fix this?