search

google / fuzzbench

FuzzBench - Fuzzer benchmarking as a service.
https://google.github.io/fuzzbench/
Apache License 2.0
1.09k stars 266 forks source link

LFUZZ Experiment #1987

Open vwrewsge opened 4 months ago

vwrewsge commented 4 months ago

Hi, @DonggeLiu

I've added a new fuzzer called lfuzz. Could you please help me run experiments with it? I have already completed the following tasks in advance:

  1. I have already run all the target programs locally for one hour each, and they all executed successfully.
  2. I have already added a dummy comment! as requested.

Thanks!

vwrewsge commented 4 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-15-aflpp --fuzzers lfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer

DonggeLiu commented 4 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-15-aflpp --fuzzers lfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer

vwrewsge commented 4 months ago

It still failed on some programs... It is weird, as I didn't change any dependencies, and it was working successfully before. Let me check again.

vwrewsge commented 4 months ago

Hi, @DonggeLiu

The issue arises during the execution of make install-dependencies. When installing the same library, it succeeds in some containers but fails in others (first image fails, second image succeeds).

image image

This problem doesn't seem to be related to the new fuzzer I added. Do you have any suggestions?

vwrewsge commented 4 months ago

Hi, @DonggeLiu

The issue arises during the execution of make install-dependencies. When installing the same library, it succeeds in some containers but fails in others (first image fails, second image succeeds). image image

This problem doesn't seem to be related to the new fuzzer I added. Do you have any suggestions?

It seems I have identified the issue. In all the unsuccessful builds, the download of Orange3-3.33.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl failed. In the successful builds, the download speed for Orange3-3.33.0 was 70-80MB/s, whereas in the unsuccessful ones, the download speed was only 3.8MB/s or less.

image image image

I'm not sure if network fluctuations would affect experiment building in the design of Fuzzbench. Therefore, I suspect that network fluctuations might be causing some builds to fail. Perhaps rerunning the builds could work?

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-15-aflpp --fuzzers lfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer
DonggeLiu commented 4 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-16-aflpp --fuzzers lfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer

vwrewsge commented 4 months ago

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-16-aflpp --fuzzers lfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer

It looks like all the checks have passed successfully, but where's the link to the experiment data and report?

DonggeLiu commented 4 months ago

Here : ) Experiment 2024-05-16-aflpp data and results will be available later at: The experiment data. The experiment report. The experiment report(experimental).

DonggeLiu commented 4 months ago

BTW, could you see the links on this page? https://github.com/google/fuzzbench/pull/1987/checks?check_run_id=25028089144

We can add the data and report links to them if you can access them.

vwrewsge commented 4 months ago

Thanks a lot !!!