issues
search
UKGovernmentBEIS
/
inspect_ai
Inspect: A framework for large language model evaluations
https://UKGovernmentBEIS.github.io/inspect_ai/
MIT License
385
stars
41
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
New benchmarks should go under benchmarks directory or in a separate package?
#19
alexandraabbas
opened
1 month ago
6
Missing __init__.py in subdirectories
#18
irenedea
closed
1 month ago
2
should solver use original input or modified input?
#17
Lovkush-A
closed
1 month ago
12
expert answer not showing in metadata in view
#16
Lovkush-A
closed
1 month ago
2
minor code aesthetic improvements
#15
Lovkush-A
closed
1 month ago
4
Langfuse integration
#14
sqr00t
closed
1 month ago
2
No support for Ollama/offline models?
#13
jimccadm
closed
1 month ago
4
Not possible to follow the basics Workflow tutorial
#12
jralduaveuthey
closed
1 month ago
2
Fix typo in README
#11
robertdeniszczyc2
closed
1 month ago
1
Typo in README
#10
robertdeniszczyc2
closed
1 month ago
1
Difficult to expand individual row elements in inspect view UI
#9
fozziethebeat
closed
1 month ago
9
Trying to `inspect view` fails with "No such file or directory" even though /logs is there
#8
navkuun
closed
1 month ago
1
Typo
#7
jonas-sandbrink
closed
1 month ago
1
Typo
#6
jonas-sandbrink
closed
1 month ago
1
Link error
#5
jonas-sandbrink
closed
1 month ago
1
Documentation fixes
#4
schmatz
closed
1 month ago
2
[Snyk] Upgrade preact from 10.19.6 to 10.20.1
#3
lorenzoAtBEIS
closed
2 months ago
0
Previous