search

google / clusterfuzz

Scalable fuzzing infrastructure.
https://google.github.io/clusterfuzz
Apache License 2.0
5.28k stars 554 forks source link

Triage task can delete unprocessed testcases that have pending tasks (applies to large groups only) #1281

Open Dor1s opened 4 years ago

Dor1s commented 4 years ago

Seems to be a rare case, but maybe we should fix it somehow.

Error from minimize task: https://pantheon.corp.google.com/errors/CKz-3e3m5KCwKQ?time=P30D&project=clusterfuzz-external

InvalidTestcaseError: Invalid test case.
at get_testcase_by_id (/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-ks9b-0/clusterfuzz/src/python/datastore/data_handler.py:122)
at do_libfuzzer_minimization (/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-ks9b-0/clusterfuzz/src/python/bot/tasks/minimize_task.py:1296)
at execute_task (/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-ks9b-0/clusterfuzz/src/python/bot/tasks/minimize_task.py:395)
at run_command (/mnt/scratch0/bots/oss-fuzz-linux-zone1-host-ks9b-0/clusterfuzz/src/python/bot/tasks/commands.py:204)

The testcase (5093992882765824) was deleted during Triage task two days ago: https://pantheon.corp.google.com/logs/viewer?project=clusterfuzz-external&minLogLevel=0&expandAll=false&timestamp=2019-12-16T19%3A25%3A41.102000000Z&customFacets&limitCustomFacetWidth=true&dateRangeEnd=2019-12-16T19%3A25%3A37.656Z&interval=PT1H&resource=gae_app&scrollTimestamp=2019-12-14T22%3A07%3A00.789415000Z&logName=projects%2Fclusterfuzz-external%2Flogs%2Fappengine.googleapis.com%252Fstderr&logName=projects%2Fclusterfuzz-external%2Flogs%2Fappengine.googleapis.com%252Fnginx.request&logName=projects%2Fclusterfuzz-external%2Flogs%2Fappengine.googleapis.com%252Frequest_log&filters=text%3A5093992882765824&dateRangeUnbound=backwardInTime&advancedFilter=resource.type%3D%22gae_app%22%0Aresource.labels.module_id%3D%22cron-service%22%0Aresource.labels.zone%3D%22us17%22%0Aresource.labels.project_id%3D%22clusterfuzz-external%22%0Aresource.labels.version_id%3D%2220191214t040221%22%0Atimestamp%3D%222019-12-14T22%3A07%3A00.789415000Z%22%0AinsertId%3D%225df56190000e7fab2df4f6ab%22


2019-12-14 14:26:12.958 PST
Deleting testcase 5093992882765824 due to overflowing group 6208392679129088. (/base/data/home/apps/s~clusterfuzz-external/cron-service:20191214t040221.423133781996235713/python/metrics/logs.py:344)
None
inferno-chromium commented 4 years ago

too high of complexity. if we delay in letting tasks finish, we risk adding too many testcases in a short duration. keeping it as "minor enchancement"