search

google / fuzzbench

FuzzBench - Fuzzer benchmarking as a service.
https://google.github.io/fuzzbench/
Apache License 2.0
1.11k stars 270 forks source link

[EXP ONLY] Re-run experiments for 2028 #2052

Open DonggeLiu opened 4 weeks ago

DonggeLiu commented 4 weeks ago

@addisoncrump Shall we run this experiment here?

DonggeLiu commented 4 weeks ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-10-21-2028-libafl --fuzzers libafl

DonggeLiu commented 4 weeks ago

Experiment 2024-10-21-2028-libafl data and results will be available later at: The experiment data. The experiment report. The experiment report(experimental).

addisoncrump commented 4 weeks ago

Sure, but I would prefer to run all baselines (AFL, AFL++, Centipede, entropic, Fairfuzz, LibAFL, libFuzzer) once this one succeeds, as the data we are collecting has changed.

DonggeLiu commented 4 weeks ago

Sure, but I would prefer to run all baselines (AFL, AFL++, Centipede, entropic, Fairfuzz, LibAFL, libFuzzer) once this one succeeds, as the data we are collecting has changed.

I see. I will run afl, afl++, centipede, libafl, and libfuzzer. The rest are less commonly used.

DonggeLiu commented 4 weeks ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-10-21-2028-base --fuzzers libafl aflplusplus centipede libfuzzer

DonggeLiu commented 4 weeks ago

Experiment 2024-10-21-2028-base data and results will be available later at: The experiment data. The experiment report. The experiment report(experimental).

addisoncrump commented 4 weeks ago

It would appear once again that the run has stalled...

DonggeLiu commented 4 weeks ago

It would appear once again that the run has stalled...

@jonathanmetzman Would you mind helping look into this at your convenience? I will be traveling for 2 weeks from tomorrow, and might not have capacity to follow closely to this.

Thanks : )