search

google / fuzzbench

FuzzBench - Fuzzer benchmarking as a service.
https://google.github.io/fuzzbench/
Apache License 2.0
1.11k stars 270 forks source link

Request an experiment for aflpp_symsan #1884

Closed chenju2k6 closed 1 year ago

chenju2k6 commented 1 year ago

Added a new fuzzer, aflpp_symsan. This fuzzer is a version of aflplusplus that features a customized mutator, which is built on top of our Concolic Execution Engine, Symsan.

DonggeLiu commented 1 year ago

Hi @chenju2k6, would you mind making a trivial modification to service/gcbrun_experiment.py? This will allow me to launch experiments in this PR before merging. Here is an example to add a dummy comment : ) Thanks!

BTW, you don't have to add experiment requests to service/experiment-requests.yaml, as we are running experiments from this PR with /gcbrun commands. Instead, could you please write the experiment request in this format? You can swap the --experiment-name and --fuzzers parameters with your values. I would really appreciate that : )

chenju2k6 commented 1 year ago

Hi @chenju2k6, would you mind making a trivial modification to service/gcbrun_experiment.py? This will allow me to launch experiments in this PR before merging. Here is an example to add a dummy comment : ) Thanks!

BTW, you don't have to add experiment requests to service/experiment-requests.yaml, as we are running experiments from this PR with /gcbrun commands. Instead, could you please write the experiment request in this format? You can swap the --experiment-name and --fuzzers parameters with your values. I would really appreciate that : )

This is the command:

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-08-17-symsan-aflpp-symsan --fuzzers symsan_aflplusplus

DonggeLiu commented 1 year ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-08-17-symsan-aflpp-symsan --fuzzers symsan_aflplusplus

DonggeLiu commented 1 year ago

This is the command:

Thanks, launched. Experiment data and results will be available later at: The experiment data. The experiment report.

Just a minor tip: FuzzBench expects experiment names to be within 30 chars. Your experiment name is perfectly fine because it is exactly 30 chars. Please consider using a shorter name in the future : ) Thanks!

chenju2k6 commented 1 year ago

@Alan32Liu Thank you for your assistance. We have received the results from our fuzzer. To provide context for these results, I would like to compare them with the results of other fuzzers using the same benchmarks. Could you please advise me on how to proceed?

DonggeLiu commented 1 year ago

@Alan32Liu Thank you for your assistance. We have received the results from our fuzzer. To provide context for these results, I would like to compare them with the results of other fuzzers using the same benchmarks. Could you please advise me on how to proceed?

Once the experiment finishes, FuzzBench will merge prev results of core fuzzers with your results. No action is needed : )

DonggeLiu commented 1 year ago

Hi @chenju2k6 , please feel free to close the PR if no further experiment is needed :) Thanks!

chenju2k6 commented 1 year ago

Thanks. Closing.