search

google / fuzzbench

FuzzBench - Fuzzer benchmarking as a service.
https://google.github.io/fuzzbench/
Apache License 2.0
1.09k stars 266 forks source link

libafl_libfuzzer optimization experiment #1903

Closed addisoncrump closed 9 months ago

addisoncrump commented 1 year ago

We made some heavy optimisations and new features that we'd like to test. Can an experiment be run for:

Thanks!

addisoncrump commented 1 year ago

having some linkage issues

addisoncrump commented 1 year ago

Found an issue with one of our recent optimisations. Marked as draft until it's fixed up.

addisoncrump commented 1 year ago

Good to go! Hunted down all the bugs with the recent optimisations (that I'm aware of... :skull:)

libafl_libfuzzer is not affected by the issue identified in #1902 because we don't use libafl_cc, so this is good to go whenever y'all are ready to fire the experiment.

addisoncrump commented 1 year ago

Rebased on the libafl updates used in #1902 for sanity.

DonggeLiu commented 12 months ago

Hi @addisoncrump, is this ready for experiments?

If so, would you mind making a trivial modification to service/gcbrun_experiment.py? This will allow me to launch experiments in this PR. Here is an example to add a dummy comment : ) Thanks!

In addition, could you please write your experiment request in this format? You can swap the --experiment-name and --fuzzers parameters with your values. I would really appreciate that : )

For example, I reckon the command for this case is:

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-10-05-libafl_best --fuzzers libafl_libfuzzer_best libafl_libfuzzer

Where FuzzBench will reuse existing results of aflplusplus and libfuzzer.

addisoncrump commented 12 months ago

We have a couple of more changes in the queue ready, so I'll send this in in a bit :slightly_smiling_face:

tokatoka commented 10 months ago

this is ready with all the pr merged? @addisoncrump

addisoncrump commented 10 months ago

Yup, let me update the commit

addisoncrump commented 10 months ago

All of the relevant libafl changes landed, so I removed libfuzzer_best. For now, this is good to go :heavy_check_mark:

Let's compare:

Thanks!

addisoncrump commented 10 months ago

Well, that didn't work. Coming back to this in the morning.

addisoncrump commented 9 months ago

Superceded by other recent PRs.