google / clusterfuzz

Scalable fuzzing infrastructure.
https://google.github.io/clusterfuzz
Apache License 2.0
5.31k stars 556 forks source link

Make sure to schedule pruning for all jobs. #4423

Closed jonathanmetzman closed 22 hours ago

jonathanmetzman commented 23 hours ago

It seems like some projects are not getting pruning tasks. This might be because we were not querying jobs correctly until this patch.

jonathanmetzman commented 22 hours ago

Hmmm...I think youre right. I think I've seen a bunch of targets where corpus_pruning isn't being scheduled (At all, so I don't think this is a batch issue). https://pantheon.corp.google.com/logs/query;query=%22Adding%20corpus%20pruning%20task%22%0A%22sound-open-firmware%22;cursorTimestamp=2024-11-21T19:25:59.304007175Z;startTime=2024-11-01T20:31:02.259Z;endTime=2024-11-21T22:31:02.259Z?e=-13802955&mods=logs_tg_prod&project=clusterfuzz-external

jonathanmetzman commented 22 hours ago

Hmmm...I think youre right. I think I've seen a bunch of targets where corpus_pruning isn't being scheduled (At all, so I don't think this is a batch issue). https://pantheon.corp.google.com/logs/query;query=%22Adding%20corpus%20pruning%20task%22%0A%22sound-open-firmware%22;cursorTimestamp=2024-11-21T19:25:59.304007175Z;startTime=2024-11-01T20:31:02.259Z;endTime=2024-11-21T22:31:02.259Z?e=-13802955&mods=logs_tg_prod&project=clusterfuzz-external

Eh turns out that project just has an i386 build. I'll look for more, becuase I've seen a lot of projects with many tens of thousands of corpus elements