inferno-chromium
commented
4 years ago I looked in some of fuzzing logs, and looks like corpus merge is running into timeouts. In your fuzz target, you should see way why so slow exec/sec (ideally should be >1000). I also need to fix a bug on ClusterFuzz side which should atleast get fuzzing crashes.
Error occurred while working on task.
Traceback (most recent call last):
File "/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-sbkv-7/clusterfuzz/src/python/bot/startup/run_bot.py", line 97, in task_loop
commands.process_command(task)
File "/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-sbkv-7/clusterfuzz/src/python/bot/tasks/commands.py", line 150, in wrapper
return func(task)
File "/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-sbkv-7/clusterfuzz/src/python/bot/tasks/commands.py", line 378, in process_command
run_command(task_name, task_argument, job_name)
File "/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-sbkv-7/clusterfuzz/src/python/bot/tasks/commands.py", line 204, in run_command
task_module.execute_task(task_argument, job_name)
File "/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-sbkv-7/clusterfuzz/src/python/bot/tasks/fuzz_task.py", line 1900, in execute_task
session.run()
File "/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-sbkv-7/clusterfuzz/src/python/bot/tasks/fuzz_task.py", line 1820, in run
crashes, fuzzer_metadata = self.do_engine_fuzzing(engine_impl)
File "/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-sbkv-7/clusterfuzz/src/python/bot/tasks/fuzz_task.py", line 1538, in do_engine_fuzzing
self.testcase_directory)
File "/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-sbkv-7/clusterfuzz/src/python/bot/tasks/fuzz_task.py", line 1252, in run_engine_fuzzer
sync_corpus_directory, testcase_directory)
File "/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-sbkv-7/clusterfuzz/src/python/bot/untrusted_runner/tasks_host.py", line 137, in engine_fuzz
response = host.stub().EngineFuzz(request)
File "/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-sbkv-7/clusterfuzz/src/third_party/grpc/_channel.py", line 532, in __call__
return _end_unary_response_blocking(state, call, False, None)
File "/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-sbkv-7/clusterfuzz/src/third_party/grpc/_channel.py", line 466, in _end_unary_response_blocking
raise _Rendezvous(state, None, None, deadline)
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNKNOWN
details = "Traceback (most recent call last):
File "/mnt/scratch0/clusterfuzz/src/python/bot/untrusted_runner/untrusted.py", line 82, in wrapper
result = func(self, request, context)
File "/mnt/scratch0/clusterfuzz/src/python/bot/untrusted_runner/untrusted.py", line 180, in EngineFuzz
return tasks_impl.engine_fuzz(request, context)
File "/mnt/scratch0/clusterfuzz/src/python/bot/untrusted_runner/tasks_impl.py", line 113, in engine_fuzz
request.testcase_directory)
File "/mnt/scratch0/clusterfuzz/src/python/bot/tasks/fuzz_task.py", line 1260, in run_engine_fuzzer
fuzz_test_timeout)
File "/mnt/scratch0/clusterfuzz/src/python/bot/fuzzers/libFuzzer/engine.py", line 316, in fuzz
options.fuzz_corpus_dirs, arguments, parsed_stats)
File "/mnt/scratch0/clusterfuzz/src/python/bot/fuzzers/libFuzzer/engine.py", line 206, in _merge_new_units
libfuzzer.DEFAULT_MERGE_TIMEOUT))
File "/mnt/scratch0/clusterfuzz/src/python/bot/fuzzers/libFuzzer/engine.py", line 412, in _minimize_corpus_two_step
reproducers_dir, max_time)
File "/mnt/scratch0/clusterfuzz/src/python/bot/fuzzers/libFuzzer/engine.py", line 485, in minimize_corpus
result.output)
TimeoutError: Merging new testcases timed out
INFO: Seed: 3264432259
INFO: Loaded 1 modules (2077 inline 8-bit counters): 2077 [0x7ebea0, 0x7ec6bd),
INFO: Loaded 1 PC tables (2077 PCs): 2077 [0x5a1ad0,0x5a9ca0),
MERGE-OUTER: 30313 files, 0 in the initial corpus, 0 processed earlier
MERGE-OUTER: attempt 1
INFO: Seed: 3264617735
INFO: Loaded 1 modules (2077 inline 8-bit counters): 2077 [0x7ebea0, 0x7ec6bd),
INFO: Loaded 1 PC tables (2077 PCs): 2077 [0x5a1ad0,0x5a9ca0),
INFO: -max_len is not provided; libFuzzer will not generate inputs larger than 1048576 bytes
MERGE-INNER: using the control file '/mcf_tmp_dir/MCF'
MERGE-INNER: 30313 total files; 0 processed earlier; will process 30313 files now
#1 pulse cov: 57 ft: 131 exec/s: 0 rss: 34Mb
#2 pulse cov: 59 ft: 138 exec/s: 0 rss: 35Mb
#4 pulse cov: 59 ft: 142 exec/s: 0 rss: 35Mb
#8 pulse cov: 60 ft: 150 exec/s: 0 rss: 35Mb
#16 pulse cov: 60 ft: 160 exec/s: 0 rss: 35Mb
#32 pulse cov: 82 ft: 309 exec/s: 0 rss: 38Mb
==4==WARNING: AddressSanitizer failed to allocate 0xfffffffffcffff27 bytes
==4==WARNING: AddressSanitizer failed to allocate 0xfffffffffcffff27 bytes
#64 pulse cov: 91 ft: 411 exec/s: 64 rss: 39Mb
==4==WARNING: AddressSanitizer failed to allocate 0xfffffffff6ffff27 bytes
==4==WARNING: AddressSanitizer failed to allocate 0xfffffffffffffc27 bytes
==4==WARNING: AddressSanitizer failed to allocate 0xffffffffffffc7d8 bytes
==4==WARNING: AddressSanitizer failed to allocate 0xfffffffffffe0028 bytes
#128 pulse cov: 101 ft: 566 exec/s: 64 rss: 41Mb
==4==WARNING: AddressSanitizer failed to allocate 0xffffffffffcaffd8 bytes
==4==WARNING: AddressSanitizer failed to allocate 0xfffffffffef93338 bytes
#256 pulse cov: 555 ft: 4761 exec/s: 51 rss: 48Mb
#512 pulse cov: 768 ft: 6995 exec/s: 51 rss: 72Mb
#1024 pulse cov: 917 ft: 9062 exec/s: 48 rss: 118Mb
#2048 pulse cov: 1194 ft: 12367 exec/s: 51 rss: 133Mb
#4096 pulse cov: 1279 ft: 15086 exec/s: 53 rss: 136Mb
==4==WARNING: AddressSanitizer failed to allocate 0xffffffffffffba90 bytes
==4==WARNING: AddressSanitizer failed to allocate 0xfffffffffa00bb90 bytes
==4==WARNING: AddressSanitizer failed to allocate 0xfffffffff300bb90 bytes
#8192 pulse cov: 1405 ft: 18309 exec/s: 31 rss: 166Mb
==4==WARNING: AddressSanitizer failed to allocate 0xffffffffbd00b993 bytes
==4==WARNING: AddressSanitizer failed to allocate 0xffffffffb9006af9 bytes
==4==WARNING: AddressSanitizer failed to allocate 0xffffffffb9006af9 bytes
==4==WARNING: AddressSanitizer failed to allocate 0xffffffffb9006af9 bytes
#16384 pulse cov: 1412 ft: 18880 exec/s: 12 rss: 169Mb
==4==WARNING: AddressSanitizer failed to allocate 0xfffffffff1006af9 bytes
thuanpv
Hi Oss-Fuzz team,
First of all, thank you for integrating the WavPack project (created and maintained by David Bryant) into your great continuous fuzzing framework. Its Dockerfile was committed ~4 days ago (https://github.com/google/oss-fuzz/tree/master/projects/wavpack).
I have just checked the results on the OSS-Fuzz Dashboard and found that the project has been built successfully and fuzzed for several hours. However, the Dashboard doesn't show any information about the code coverage achieved so far. In the build logs, there is no coverage build for WavPack.
Could you please explain to me (potential) reason(s) and suggest the changes that I need to make to get the code coverage results displayed on the Oss-Fuzz dashboard?
Thanks,
Thuan