search

google / oss-fuzz-gen

LLM powered fuzzing via OSS-Fuzz.
Apache License 2.0
780 stars 92 forks source link

ci: enable use of local fuzz introspector webapp #423

Closed DavidKorczynski closed 2 weeks ago

DavidKorczynski commented 2 weeks ago

Adds logic for running experiments using a local deployment of the introspector webapp. This can (1) help with network failures and (2) make it possible to run experiments if for some reason introspector.oss-fuzz.com is down.

Also adds a small benchmark directory with a single project which is meant for PRs that don't need full experiments to run, but where it would still be nice to test a full run to make sure the infrastructure doesn't break.

DavidKorczynski commented 2 weeks ago

This supersedes https://github.com/google/oss-fuzz-gen/pull/305

DavidKorczynski commented 2 weeks ago

/gcbrun exp -n dk-test-infra140 -m vertex_ai_gemini-1-5 -b minor-for-ci -i

DavidKorczynski commented 2 weeks ago

/gcbrun exp -n dk-test-infra141 -m vertex_ai_gemini-1-5 -b minor-for-ci -i

DavidKorczynski commented 2 weeks ago

/gcbrun exp -n dk-test-infra142 -m vertex_ai_gemini-1-5 -b minor-for-ci -i

DavidKorczynski commented 2 weeks ago

Experiment is looking good

DavidKorczynski commented 2 weeks ago

/gcbrun exp -n dk-test-infra142 -m vertex_ai_gemini-1-5 -b minor-for-ci

DavidKorczynski commented 2 weeks ago

/gcbrun exp -n dk-test-infra5000 -m vertex_ai_gemini-1-5 -b minor-for-ci

DavidKorczynski commented 2 weeks ago

/gcbrun exp -n dk-test-infra5001 -m vertex_ai_gemini-1-5 -b minor-for-ci -i