issues
search
mlcommons
/
modelgauge
Make it easy to automatically and uniformly measure the behavior of many AI Systems.
https://mlcommons.org/ai-safety/
Apache License 2.0
26
stars
7
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Daily Scheduled Test Failure
#594
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#593
github-actions[bot]
closed
1 month ago
0
Add --top-p and --temp to CLI
#592
bkorycki
opened
2 months ago
0
Daily Scheduled Test Failure
#591
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#590
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#589
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#588
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#587
github-actions[bot]
closed
1 month ago
0
New file organization for safe v1
#586
bkorycki
opened
2 months ago
0
Tests get newest dependency versions
#585
bkorycki
opened
2 months ago
0
Daily Scheduled Test Failure
#584
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#583
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#582
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#581
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#580
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#579
github-actions[bot]
closed
1 month ago
0
Archive modelgauge
#578
bkorycki
closed
1 month ago
0
Daily Scheduled Test Failure
#577
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#576
github-actions[bot]
closed
1 month ago
0
Unite hugging face secrets
#575
bkorycki
opened
2 months ago
4
Daily Scheduled Test Failure
#574
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#573
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#572
github-actions[bot]
closed
1 month ago
0
Daily Scheduled Test Failure
#571
github-actions[bot]
closed
1 month ago
0
Improve separation of concerns in tests
#570
rogthefrog
opened
2 months ago
1
Daily Scheduled Test Failure
#569
github-actions[bot]
closed
1 month ago
0
Automatically start/stop huggingface endpoints
#568
bkorycki
opened
2 months ago
0
New reference models
#567
wpietri
opened
2 months ago
0
Update poetry.lock
#566
bkorycki
closed
2 months ago
1
version bump 0.6.3
#565
bkorycki
closed
2 months ago
1
Safetests use first batch of real v1.0 prompts
#564
bkorycki
opened
2 months ago
0
Safetests use first batch of v1.0 prompts
#563
bkorycki
closed
2 months ago
1
Daily Scheduled Test Failure
#562
github-actions[bot]
closed
1 month ago
0
HuggingFace Inference SUT
#561
bkorycki
closed
2 months ago
3
Refactor: encapsulate annotators used in safe tests
#560
rogthefrog
closed
2 months ago
10
mypy is a little overzealous
#559
rogthefrog
closed
2 months ago
1
mypy is complaining about untyped imports
#558
rogthefrog
closed
2 months ago
1
Encapsulate private annotators better
#557
rogthefrog
closed
2 months ago
3
Redo modelgauge homepage to match current notions
#556
wpietri
opened
2 months ago
0
Add wildguard annotator to modelgauge's private annotators
#555
rogthefrog
closed
2 months ago
1
Add the wildguard private annotator, with some refactoring.
#554
rogthefrog
closed
2 months ago
1
update to v0.6.2
#553
wpietri
closed
2 months ago
1
Ensure modelgauge works with llamaguard by default
#552
dhosterman
opened
2 months ago
0
Include gemma 9b in SUT list (HF)
#551
bollacker
opened
2 months ago
0
Officially add new annotators
#550
bkorycki
closed
2 months ago
1
Improve release notes
#549
wpietri
closed
2 months ago
1
Version 0.6.1
#548
wpietri
closed
2 months ago
1
Ensemble annotator in v1.0 test
#547
bkorycki
opened
2 months ago
0
Remove deprecated models, and update tests to match
#546
rogthefrog
closed
2 months ago
1
Daily Scheduled Test Failure
#545
github-actions[bot]
closed
1 month ago
0
Next