search

google / fuzzbench

FuzzBench - Fuzzer benchmarking as a service.
https://google.github.io/fuzzbench/
Apache License 2.0
1.11k stars 270 forks source link

Testing grimoire fuzzer #1864

Closed tokatoka closed 1 year ago

tokatoka commented 1 year ago

Thanks for all the tests in #1840

We would like to test another fuzzer using grimoire

tokatoka commented 1 year ago

libafl_fuzzbench_grimoire is the only fuzzer we want to test

tokatoka commented 1 year ago

@Alan32Liu Hello, can we merge this?

Also I have a question, Can we download this "Pairwise Unique Code Coverage" as a text or csv? https://www.fuzzbench.com/reports/experimental/2023-05-22-libafl-var/index.html#pairwise-unique-code-coverage-1

This could be useful but I don't see this data included in this link https://www.fuzzbench.com/reports/experimental/2023-05-22-libafl-var/data.csv.gz

DonggeLiu commented 1 year ago

Hello, can we merge this?

Sure, but auto-experiment has been down recently. Alternatively, we can launch experiments in this PR before merging.

Can we download this "Pairwise Unique Code Coverage" as a text or csv?

Unfortunately, I don't think those data are saved.

DonggeLiu commented 1 year ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-06-22-libafl --fuzzers libafl_fuzzbench_grimoire

DonggeLiu commented 1 year ago

BTW, feel free to omit the change in service/experiment-requests.yaml to resolve the conflict: It is no longer unnecessary as the experiment has been launched here : ) Similarly, the dummy comment in service/gcbrun_experiment.py is not necessary if no further experiment is required in this PR.

DonggeLiu commented 1 year ago

The experiment has been launched successfully and its data & report should be available shortly: The experiment data. The experiment report.

tokatoka commented 1 year ago

thank you!

Unfortunately, I don't think those data are saved.

ok so if i want these table, i have to generate this myself from coverage.json