search

google / fuzzbench

FuzzBench - Fuzzer benchmarking as a service.
https://google.github.io/fuzzbench/
Apache License 2.0
1.11k stars 270 forks source link

Cfuzz #1875

Closed zerokay closed 1 year ago

zerokay commented 1 year ago

cfuzz experiment (compare against core fuzzers)

google-cla[bot] commented 1 year ago

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

zerokay commented 1 year ago

hi, @Alan32Liu I have successfully signed google-cla. However, I received the message: The modified files do not match the file filter. What should I do next? Thanks.

DonggeLiu commented 1 year ago

Would you mind making a trivial modification to service/gcbrun_experiment.py? This will allow me to launch experiments in this PR before merging. Here is an example to add a dummy comment : ) Thanks!

zerokay commented 1 year ago

Would you mind making a trivial modification to service/gcbrun_experiment.py? This will allow me to launch experiments in this PR before merging. Here is an example to add a dummy comment : ) Thanks!

Done

DonggeLiu commented 1 year ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-07-26-cfuzz --fuzzers cfuzz

DonggeLiu commented 1 year ago

Done

The names of core fuzzers are not included in the command, because FuzzBench should be able to reuse past results.

DonggeLiu commented 1 year ago

Experiment data and results will be available at: The experiment data. The experiment report.

DonggeLiu commented 1 year ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-07-27-cfuzz --fuzzers cfuzz

DonggeLiu commented 1 year ago

Experiment data and results will be available at: The experiment data. The experiment report.

zerokay commented 1 year ago

Experiment data and results will be available at: The experiment data. The experiment report.

I have made the following settings in the experience-requests.yaml to compare with these fuzzers.

  • experiment: 2023-07-23-cfuzz description: "cfuzz experiment (compare against core fuzzers)" fuzzers:
    • afl
    • aflfast
    • aflplusplus
    • aflsmart
    • entropic
    • eclipser
    • fairfuzz
    • honggfuzz
    • lafintel
    • libfuzzer
    • mopt
    • cfuzz

But I didn't see this comparison in the report.

DonggeLiu commented 1 year ago

The base fuzzer data should be added once the experiment completes.

zerokay commented 1 year ago

Thanks! @Alan32Liu