issues
search
scicode-bench
/
SciCode
A benchmark that challenges language models to code solutions for scientific problems
Apache License 2.0
87
stars
9
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Ground Truth Code for problems_all.jsonl
#20
jasonzliang
opened
2 weeks ago
1
Fix existed files check error
#19
YanxinLu
closed
3 weeks ago
0
add new claude-3-5-sonnet-20241022
#18
Kreijstal
opened
3 weeks ago
0
o1 models results
#17
stalkermustang
closed
1 month ago
1
Update README.md - add link to faq
#16
ofirpress
closed
2 months ago
0
chore: update pre-commit hooks
#15
pre-commit-ci[bot]
opened
2 months ago
0
Request to evaluate the new O1 models by OpenAI (O1-preview and O1-mini)
#14
Belzedar94
closed
2 months ago
2
Mention FAQ/link to website repo
#13
klieret
closed
2 months ago
0
Solution generation skips certain steps?
#12
idavidrein
closed
2 months ago
2
Integrate SciCode Dataset into OpenCompass Framework
#11
HariSeldon0
closed
2 weeks ago
0
chore: update pre-commit hooks
#10
pre-commit-ci[bot]
closed
2 months ago
0
chore: update pre-commit hooks
#9
pre-commit-ci[bot]
closed
3 months ago
0
Potentially Too Strict Judgement on Calculated Result
#8
XuGW-Kevin
closed
4 months ago
2
add background prompt template
#7
YanxinLu
closed
4 months ago
0
One click run
#6
ofirpress
opened
4 months ago
0
Improve discoverability of your work on Hugging Face
#5
NielsRogge
opened
4 months ago
1
support litellm and bg setup
#4
YanxinLu
closed
4 months ago
0
chore: update pre-commit hooks
#3
pre-commit-ci[bot]
closed
4 months ago
0
Dependency versions for evaluation
#2
zrait
opened
4 months ago
0
Inquiry on Skipping Specific Problems in SciCode Benchmark
#1
HariSeldon0
closed
4 months ago
1