search

google / fuzzbench

FuzzBench - Fuzzer benchmarking as a service.
https://google.github.io/fuzzbench/
Apache License 2.0
1.09k stars 266 forks source link

TuneFuzz module testing #1964

Open kdsjZh opened 6 months ago

kdsjZh commented 6 months ago

Hi, we want to test a standalone module of TuneFuzz and its updated version. This module's origin implementation has been merged into AFL++ and we want to compare old AFL++ mode, new AFL++ mode (origin TuneFuzz module implementation) and an optimized implementation.

@DonggeLiu Could you help us evaluate three fuzzers (aflplusplus, aflplusplus_sk and aflplusplus_sk_brute)? Thanks!


/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-03-25-tunemodule --fuzzers aflplusplus aflplusplus_sk aflplusplus_sk_brute
DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-03-26-tunemodule --fuzzers aflplusplus aflplusplus_sk aflplusplus_sk_brute

It appears this did not trigger exp, let me re-try below.

DonggeLiu commented 6 months ago

Experiment 2024-03-26-tunemodule data and results will be available later at: The experiment data. The experiment report.

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-03-26-tunemodule --fuzzers aflplusplus aflplusplus_sk aflplusplus_sk_brute

kdsjZh commented 6 months ago

Hi Dongge, could you help us testing the bug benchmark as well? Thanks!

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-03-28-tune-bug --fuzzers aflplusplus aflplusplus_sk aflplusplus_sk_brute --benchmarks bloaty_fuzz_target_52948c harfbuzz_hb-shape-fuzzer_17863b libxml2_xml_e85b9b mbedtls_fuzz_dtlsclient_7c6b0e php_php-fuzz-parser_0dbedb
DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-03-29-tune-bug --fuzzers aflplusplus aflplusplus_sk aflplusplus_sk_brute --benchmarks bloaty_fuzz_target_52948c harfbuzz_hb-shape-fuzzer_17863b libxml2_xml_e85b9b mbedtls_fuzz_dtlsclient_7c6b0e php_php-fuzz-parser_0dbedb

DonggeLiu commented 6 months ago

Experiment 2024-03-29-tune-bug data and results will be available later at: The experiment data. The experiment report.