search

google / fuzzbench

FuzzBench - Fuzzer benchmarking as a service.
https://google.github.io/fuzzbench/
Apache License 2.0
1.11k stars 269 forks source link

[DO NOT MERGE] Latest experiment #1985

Open DonggeLiu opened 6 months ago

DonggeLiu commented 6 months ago

Running a coverage-based and bug-based experiment with the latest infra, fuzzer, and benchmarks.

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-13-new-cov --fuzzers afl aflplusplus aflsmart centipede honggfuzz libafl libfuzzer mopt

DonggeLiu commented 6 months ago

Experiment 2024-05-13-new-cov data and results will be available later at: The experiment data. The experiment report.

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-13-new-bug --fuzzers afl aflplusplus aflsmart centipede honggfuzz libafl libfuzzer mopt --benchmarks arrow_arrow-ipc-stream-fuzz_1a34a0 aspell_aspell_fuzzer_e8eb74 assimp_assimp_fuzzer_4d451f bloaty_fuzz_target_52948c ffmpeg_ffmpeg_demuxer_fuzzer_7adeef file_magic_fuzzer_2d5f85 grok_grk_decompress_fuzzer_9cd001 harfbuzz_hb-shape-fuzzer_17863b lcms_cms_transform_all_fuzzer_97d37d libaom_av1_dec_fuzzer_6e1848 libpcap_fuzz_filter_98b0a2 libxml2_xml_e85b9b mbedtls_fuzz_dtlsclient_7c6b0e php_php-fuzz-parser_0dbedb systemd_fuzz-network-parser_288baf

DonggeLiu commented 6 months ago

Experiment 2024-05-13-new-bug data and results will be available later at: The experiment data. The experiment report.

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-13-new-bug --fuzzers afl aflplusplus aflsmart centipede honggfuzz libafl libfuzzer mopt --benchmarks arrow_arrow-ipc-stream-fuzz_1a34a0 aspell_aspell_fuzzer_e8eb74 assimp_assimp_fuzzer_4d451f bloaty_fuzz_target_52948c ffmpeg_ffmpeg_demuxer_fuzzer_7adeef file_magic_fuzzer_2d5f85 grok_grk_decompress_fuzzer_9cd001 harfbuzz_hb-shape-fuzzer_17863b lcms_cms_transform_all_fuzzer_97d37d libaom_av1_dec_fuzzer_6e1848 libpcap_fuzz_filter_98b0a2 libxml2_xml_e85b9b mbedtls_fuzz_dtlsclient_7c6b0e php_php-fuzz-parser_0dbedb systemd_fuzz-network-parser_288baf

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-16-new-bug --fuzzers afl aflplusplus aflsmart honggfuzz libafl libfuzzer mopt --benchmarks arrow_arrow-ipc-stream-fuzz_1a34a0 aspell_aspell_fuzzer_e8eb74 assimp_assimp_fuzzer_4d451f bloaty_fuzz_target_52948c ffmpeg_ffmpeg_demuxer_fuzzer_7adeef file_magic_fuzzer_2d5f85 grok_grk_decompress_fuzzer_9cd001 harfbuzz_hb-shape-fuzzer_17863b lcms_cms_transform_all_fuzzer_97d37d libaom_av1_dec_fuzzer_6e1848 libpcap_fuzz_filter_98b0a2 libxml2_xml_e85b9b mbedtls_fuzz_dtlsclient_7c6b0e php_php-fuzz-parser_0dbedb systemd_fuzz-network-parser_288baf

DonggeLiu commented 6 months ago

Experiment 2024-05-16-new-bug data and results will be available later at: The experiment data. The experiment report.

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-17-new-bug --fuzzers afl aflplusplus honggfuzz libafl libfuzzer --benchmarks bloaty_fuzz_target_52948c harfbuzz_hb-shape-fuzzer_17863b libxml2_xml_e85b9b mbedtls_fuzz_dtlsclient_7c6b0e php_php-fuzz-parser_0dbedb

DonggeLiu commented 6 months ago

Experiment 2024-05-17-new-bug data and results will be available later at: The experiment data. The experiment report.

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-20-new-bug-arrow --fuzzers afl aflplusplus honggfuzz libafl libfuzzer --benchmarks arrow_arrow-ipc-stream-fuzz_1a34a0

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-20-new-bug-aspell --fuzzers afl aflplusplus honggfuzz libafl libfuzzer --benchmarks aspell_aspell_fuzzer_e8eb74

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-20-new-bug-assimp --fuzzers afl aflplusplus honggfuzz libafl libfuzzer --benchmarks assimp_assimp_fuzzer_4d451f

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-20-new-bug-ffmpeg --fuzzers afl aflplusplus honggfuzz libafl libfuzzer --benchmarks ffmpeg_ffmpeg_demuxer_fuzzer_7adeef

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-20-new-bug-file --fuzzers afl aflplusplus honggfuzz libafl libfuzzer --benchmarks file_magic_fuzzer_2d5f85

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-20-new-bug-grok --fuzzers afl aflplusplus honggfuzz libafl libfuzzer --benchmarks grok_grk_decompress_fuzzer_9cd001

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-20-new-bug-lcms --fuzzers afl aflplusplus honggfuzz libafl libfuzzer --benchmarks lcms_cms_transform_all_fuzzer_97d37d

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-20-new-bug-libaom --fuzzers afl aflplusplus honggfuzz libafl libfuzzer --benchmarks libaom_av1_dec_fuzzer_6e1848

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-20-new-bug-libpcap --fuzzers afl aflplusplus honggfuzz libafl libfuzzer --benchmarks libpcap_fuzz_filter_98b0a2

DonggeLiu commented 6 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-20-new-bug-systemd --fuzzers afl aflplusplus honggfuzz libafl libfuzzer --benchmarks systemd_fuzz-network-parser_288baf

DonggeLiu commented 6 months ago

Experiment 2024-05-20-new-bug-arrow data and results will be available later at: The experiment data. The experiment report.

Experiment 2024-05-20-new-bug-aspell data and results will be available later at: The experiment data. The experiment report.

Experiment 2024-05-20-new-bug-assimp data and results will be available later at: The experiment data. The experiment report.

Experiment 2024-05-20-new-bug-ffmpeg data and results will be available later at: The experiment data. The experiment report.

Experiment 2024-05-20-new-bug-file data and results will be available later at: The experiment data. The experiment report.

Experiment 2024-05-20-new-bug-grok data and results will be available later at: The experiment data. The experiment report.

Experiment 2024-05-20-new-bug-lcms data and results will be available later at: The experiment data. The experiment report.

Experiment 2024-05-20-new-bug-libaom data and results will be available later at: The experiment data. The experiment report.

Experiment 2024-05-20-new-bug-libpcap data and results will be available later at: The experiment data. The experiment report.

Experiment 2024-05-20-new-bug-systemd data and results will be available later at: The experiment data. The experiment report.

gtt1995 commented 5 months ago

Running a coverage-based and bug-based experiment with the latest infra, fuzzer, and benchmarks.

Running a coverage-based and bug-based experiment with the latest infra, fuzzer, and benchmarks.

Running a coverage-based and bug-based experiment with the latest infra, fuzzer, and benchmarks.

Hi dongge, If I want to deploy both coverage-based and bug-based experiments, which branch should I choose? master or new-exp from two weeks ago? or other commit? Thanks.

DonggeLiu commented 5 months ago

Running a coverage-based and bug-based experiment with the latest infra, fuzzer, and benchmarks.

Running a coverage-based and bug-based experiment with the latest infra, fuzzer, and benchmarks.

Running a coverage-based and bug-based experiment with the latest infra, fuzzer, and benchmarks.

Hi dongge, If I want to deploy both coverage-based and bug-based experiments, which branch should I choose? master or new-exp from two weeks ago? or other commit? Thanks.

This branch.