issues
search
leondz
/
garak
LLM vulnerability scanner
https://discord.gg/uVch4puUCs
Apache License 2.0
1.02k
stars
120
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
align detector output types & results
#756
leondz
opened
11 hours ago
0
`litellm` generator input validation breaks on default cases
#755
leondz
opened
1 day ago
0
probe: assess 🤗 repos for potentially malicious files
#754
leondz
opened
3 days ago
2
only download HF models when generation is required
#753
leondz
opened
3 days ago
0
probe: VisualWebArena-Adv
#752
leondz
opened
5 days ago
0
log the config of each plugin at load time
#751
leondz
opened
5 days ago
0
atkgen forking HF tokenizer despite being non-parallel
#750
leondz
opened
1 week ago
0
remove extraneous default params for nims that expect conservative pa…
#749
leondz
closed
20 hours ago
1
nim openai endpoints reject requests with unexpected params in payload
#748
leondz
closed
20 hours ago
1
InjectZalgo sometimes has very high prompt counts
#747
leondz
opened
1 week ago
0
probe: chatgpt pii exfil
#746
leondz
opened
1 week ago
0
feature: generator temp / random seed shuffle
#745
leondz
opened
1 week ago
0
Handle openai 400 errors more gracefully
#744
leondz
closed
1 week ago
0
return value from `batch_decode` is already a list
#743
jmartin-tech
closed
1 week ago
0
Refactor `huggingface` config support
#742
jmartin-tech
opened
1 week ago
0
only set generations if still default
#741
jmartin-tech
closed
1 week ago
0
add probe for "grandma" attack
#740
leondz
closed
1 week ago
1
add garak preprint paper
#739
leondz
closed
1 week ago
0
require probes to match input modality of the generator
#738
jmartin-tech
closed
1 week ago
0
update `glitch` plugin
#737
leondz
opened
1 week ago
0
Target LM Studio
#736
osok
closed
1 week ago
1
add 'complete' message to report at end of run
#735
leondz
closed
1 week ago
0
probe: disguise & reconstruct
#734
leondz
opened
2 weeks ago
0
Linting - 20240612
#733
leondz
closed
2 weeks ago
0
ensure report is printed in `utf-8` for Windows
#732
jmartin-tech
closed
2 weeks ago
1
CUDA out of memory
#731
kbmlcoding
closed
2 weeks ago
1
utilize GarakException in cli
#730
jmartin-tech
closed
2 weeks ago
0
restore `req_template_json_object` lost in refactor
#729
jmartin-tech
closed
2 weeks ago
0
BEAST Attack Implementation
#728
erickgalinkin
opened
2 weeks ago
0
add attack vector & impact info to probes
#727
leondz
opened
2 weeks ago
0
add "done" entry to report.jsonl
#726
leondz
closed
1 week ago
0
`garak.analyze.report_digest` html output skips mention of probes used if the module score is 100%
#725
leondz
opened
2 weeks ago
0
give more friendly message when `openaicompatible`/`nim` named model not found
#724
leondz
opened
2 weeks ago
0
don't do a `tqdm` when generating just one item
#723
leondz
opened
3 weeks ago
0
InferenceEndpoint Generator fails for AWS because of missing Authorization header
#722
erikinfo
opened
3 weeks ago
4
Contributing to examples or tutorials
#721
cyberholics
opened
3 weeks ago
2
add hooks in `base.Detector`
#720
leondz
opened
3 weeks ago
0
stop instantiating detectors in `analyze.report_digest`
#719
leondz
opened
3 weeks ago
0
Remove support for openai api v0
#718
leondz
closed
2 weeks ago
0
lazi-fy huggingface, langchain serve, litellm loading
#717
leondz
opened
3 weeks ago
1
octo generator loads slow
#716
leondz
opened
3 weeks ago
0
generators: move read timeout up to global/`base.Generator` config item
#715
leondz
opened
3 weeks ago
0
refactor detectors.dan
#714
leondz
opened
3 weeks ago
0
tests: check plugin modules for classes that aren't picked up by plugin enumeration
#713
leondz
opened
3 weeks ago
0
doc & inheritance fixes to DanInTheWildMini
#712
leondz
closed
3 weeks ago
0
Feature: configurable plugins
#711
jmartin-tech
closed
2 weeks ago
2
additional `coherechat` generator to reflect `/chat` endpoint
#710
GangGreenTemperTatum
closed
3 weeks ago
1
remove `openai_v0` plugin
#709
leondz
closed
2 weeks ago
0
Improve cloze data for `leakreplay` probe
#708
leondz
closed
4 weeks ago
0
speedup report generation by using class attribs instead of instantiating
#707
leondz
closed
4 weeks ago
3
Next