google / fuzzbench

FuzzBench - Fuzzer benchmarking as a service.
https://google.github.io/fuzzbench/
Apache License 2.0
1.09k stars 266 forks source link

Why the report-data only contains the code covrage data? #1972

Open xubenji opened 5 months ago

xubenji commented 5 months ago

I want to generate data about bugs. Do you know how to adjust it?

xubenji commented 5 months ago

Where I can find the crash numbers?

Ice1187 commented 4 months ago

When running experiments, choose the benchmarks that have type: bug in their benchmark.yaml, then the report will contain bug-coverage-related information. An example report can be found here. Currently, the benchmarks with bug type are:

bloaty_fuzz_target_52948c/benchmark.yaml:type: bug
harfbuzz_hb-shape-fuzzer_17863b/benchmark.yaml:type: bug
php_php-fuzz-parser_0dbedb/benchmark.yaml:type: bug
mbedtls_fuzz_dtlsclient_7c6b0e/benchmark.yaml:type: bug
libxml2_xml_e85b9b/benchmark.yaml:type: bug

You can find the crashes in the /tmp/experiment-data/experiment-folders/[benchmark]-[fuzzer]/trail-[N]/crashes directory.

kd610 commented 1 month ago

Hi there and @Ice1187 . Is there any possible way of making a bug targeting benchmark dataset manually?