search

google / fuzzbench

FuzzBench - Fuzzer benchmarking as a service.
https://google.github.io/fuzzbench/
Apache License 2.0
1.11k stars 270 forks source link

experiment request for fafuzz #1878

Open Mart11n opened 1 year ago

Mart11n commented 1 year ago

Experiment request for fafuzz, afl, aflpp and mopt

jonathanmetzman commented 1 year ago

Let me run this tomorrow.

jonathanmetzman commented 1 year ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-08-04-fafuzz --fuzzers fafuzz afl aflplusplus_407 mopt --benchmarks bloaty_fuzz_target curl_curl_fuzzer_http freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer jsoncpp_jsoncpp_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer mbedtls_fuzz_dtlsclient openssl_x509 systemd_fuzz-link-parser vorbis_decode_fuzzer zlib_zlib_uncompress_fuzzer re2_fuzzer sqlite3_ossfuzz woff2_convert_woff2ttf_fuzzer

jonathanmetzman commented 1 year ago

Looks like there's a bug with our experiments I got to fix first.

Mart11n commented 1 year ago

Thank you 😁

Mart11n commented 1 year ago

Hi, any update on this issue? Thank you.

DonggeLiu commented 1 year ago

Hi, any update on this issue? Thank you.

Yes, I think it is fixed now. I will close&reopen this PR to apply the fix.

DonggeLiu commented 1 year ago

The experiment cloud builder shows up in the CI now.

However, would you mind making a trivial modification to service/gcbrun_experiment.py? This will allow me to launch experiments in this PR before merging. Here is an example to add a dummy comment : ) Thanks!

Mart11n commented 1 year ago

Hi, are these commits ready for the experiment? If not, please let me know. Thx for your work!

DonggeLiu commented 1 year ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-10-05-fafuzz --fuzzers fafuzz afl aflplusplus_407 mopt aflpp_fa --benchmarks bloaty_fuzz_target curl_curl_fuzzer_http freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer jsoncpp_jsoncpp_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer mbedtls_fuzz_dtlsclient openssl_x509 systemd_fuzz-link-parser vorbis_decode_fuzzer zlib_zlib_uncompress_fuzzer re2_fuzzer sqlite3_ossfuzz woff2_convert_woff2ttf_fuzzer

DonggeLiu commented 1 year ago

Hi @Mart11n, I am terribly sorry about the delay. I accidentally missed your last message. If this happens again, please always feel free to @ and ping us.

Experiment 2023-10-05-fafuzz data and results will be available later at: The experiment data. The experiment report.

DonggeLiu commented 1 year ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-10-04-fafuzz --fuzzers fafuzz afl aflplusplus_407 mopt aflpp_fa --benchmarks bloaty_fuzz_target curl_curl_fuzzer_http freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer jsoncpp_jsoncpp_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer mbedtls_fuzz_dtlsclient openssl_x509 systemd_fuzz-link-parser vorbis_decode_fuzzer zlib_zlib_uncompress_fuzzer re2_fuzzer sqlite3_ossfuzz woff2_convert_woff2ttf_fuzzer