issues
search
hendrycks
/
apps
APPS: Automated Programming Progress Standard (NeurIPS 2021)
MIT License
413
stars
55
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Leaderboard?
#32
TomLucidor
opened
1 week ago
1
Do I need to still reindent if I'm using the APPS dataset hosted on HuggingFace?
#31
Laknath1996
closed
4 months ago
1
Update apps evaluations to use HF
#30
steven-safeai
closed
5 months ago
0
Problem in ground-truth solutions
#29
nicoladainese96
closed
5 months ago
2
Can this dataset test for chatgpt?(gpt 3.5?)
#28
syccxdr
closed
1 year ago
10
check5 in function "run_test" seem to bring some wrong result
#27
Zyq-scut
opened
1 year ago
2
About Solutiions' validity
#26
MrBlack0220
closed
1 year ago
1
Steps About Generated Code Solutions Post-processing
#25
MrBlack0220
closed
5 months ago
1
answer_type calculation is different for train/val and eval
#24
minimario
closed
5 months ago
1
Unable to run pre-trained (1.5B) model on test set
#23
geajack
closed
5 months ago
2
Too Long Problems
#22
MT010104
opened
2 years ago
8
Actually call reliability guard
#21
bycn
closed
2 years ago
0
Problems With APPS
#20
MT010104
closed
2 years ago
4
Problems with fine-tuning
#19
MT010104
closed
2 years ago
0
Request for scripts of fine-tuning
#18
MT010104
closed
2 years ago
3
Running instructions
#17
PulkitMadan
closed
2 years ago
4
Fix memory leak and add reliabilty guard
#16
loubnabnl
closed
2 years ago
2
Test case average of solutions in real dataset
#15
sindhura97
closed
2 years ago
8
Nan test case average
#14
sindhura97
closed
2 years ago
5
evaluation on multiple solutions at once causes memory leak
#13
loubnabnl
closed
2 years ago
14
update the computation of scores and errors
#12
loubnabnl
closed
2 years ago
1
Computation of the accuracy scores when there are compilation and runtime errors
#11
loubnabnl
closed
2 years ago
7
Show a data instance in the readme
#10
ocramz
closed
2 years ago
2
DeepSpeed config and TrainingArguments mismatch
#9
dpfried
closed
2 years ago
2
Request for pretrained models
#8
changranelk
closed
2 years ago
2
Asking for scripts for pre-processing
#7
zfchenUnique
closed
2 years ago
2
GPT-2 0.1B weights
#6
pczubows
closed
3 years ago
1
Broken dataset download link
#5
pczubows
closed
3 years ago
2
Missing apps-train-files json file?
#4
ywen666
closed
3 years ago
5
Why don't add sorted(problems) to pin problems sorting?
#3
guoday
closed
3 years ago
1
Categorization of Problem Difficulty
#2
eelxpeng
closed
3 years ago
3
Wrong arXiv link in main read me file
#1
santiontanon
closed
3 years ago
1