search

google / fuzzbench

FuzzBench - Fuzzer benchmarking as a service.
https://google.github.io/fuzzbench/
Apache License 2.0
1.09k stars 266 forks source link

FormatFuzz Testing #1988

Open FormatFuzz opened 4 months ago

FormatFuzz commented 4 months ago

Hi, @DonggeLiu

I have a new fuzzer based on AFL++ that I would like to test it. Could you help me run it?

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-16-formatfuzz --fuzzers formatfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer
google-cla[bot] commented 4 months ago

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

DonggeLiu commented 4 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-16-formatfuzz --fuzzers formatfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer

DonggeLiu commented 4 months ago

Experiment 2024-05-16-formatfuzz data and results will be available later at: The experiment data. The experiment report. The experiment report(experimental).

FormatFuzz commented 4 months ago

I just fixed a bug. But there is no need to rerun the experiment. This bug doesn't affect my experiment. Thanks!

FormatFuzz commented 4 months ago

Hi, @DonggeLiu

I have updated my code. Could you please help me run a new experiment?

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-17-formatfuzz --fuzzers formatfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer
DonggeLiu commented 4 months ago

Sure, @FormatFuzz! I just approved the CIs, could you please check if their logs look good to you?

We can start the exp if they behave as expected : )

FormatFuzz commented 4 months ago

their logs

The logs look good : )

DonggeLiu commented 4 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-18-formatfuzz --fuzzers formatfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer

DonggeLiu commented 4 months ago

Experiment 2024-05-18-formatfuzz data and results will be available later at: The experiment data. The experiment report. The experiment report(experimental).

FormatFuzz commented 4 months ago

Hi, @DonggeLiu

I just updated my code. Could you help me run a new experiment?

Thanks! : )

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-19-formatfuzz --fuzzers formatfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer
DonggeLiu commented 4 months ago

I just updated my code. Could you help me run a new experiment?

Sure! Let's check CI results first : )

FormatFuzz commented 4 months ago

I just updated my code. Could you help me run a new experiment?

Sure! Let's check CI results first : )

The logs look good : )

DonggeLiu commented 4 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-19-formatfuzz --fuzzers formatfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer

DonggeLiu commented 4 months ago

Experiment 2024-05-19-formatfuzz data and results will be available later at: The experiment data. The experiment report. The experiment report(experimental).