leondz / garak

LLM vulnerability scanner
https://discord.gg/uVch4puUCs
Apache License 2.0
1.32k stars 151 forks source link

ux: indicate when module-based probespec leaves nothing to do #830

Open leondz opened 1 month ago

leondz commented 1 month ago

asking for -p test expands to nothing, now that everything in probes.test is active=False, so the user gets a "nothing to do" and garak quits.

this is unintuitive.

consider reporting something like "all probes in test are marked inactive, select one or more by name to continue" instead