issues
search
nuprl
/
MultiPL-E
A multi-programming language benchmark for LLMs
https://nuprl.github.io/MultiPL-E/
Other
200
stars
38
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
add num_gpu arg
#105
cassanof
closed
1 year ago
0
typo
#104
cassanof
closed
1 year ago
0
no tqdm
#103
cassanof
closed
1 year ago
0
Add vLLM support
#102
cassanof
closed
1 year ago
0
Typed Luau translator
#101
cassanof
closed
1 year ago
1
Add flag to skip failing tests
#100
cassanof
closed
1 year ago
0
fixed bug with type inference
#99
cassanof
closed
1 year ago
0
Add LeetCode as source datasets
#98
cassanof
closed
1 year ago
3
fix estimator missing for -k
#97
cassanof
closed
1 year ago
0
Dev merging
#96
arjunguha
closed
1 year ago
7
Fix MATLAB translator and evaluation to be much, much less brittle
#95
qubitter
closed
3 months ago
7
Dev - add Ziglang
#94
jelber2
closed
10 months ago
9
Add Haskell translator
#93
Cajunvoodoo
closed
1 year ago
7
Dev
#92
JohnGouwar
closed
1 year ago
0
Could I get all statistics?
#91
sh0416
closed
1 year ago
2
load_dataset() doesn't work without specifying dataset_revision?
#90
ShushanArakelyan
closed
3 months ago
2
Error evaluating TS/Java
#89
memray
opened
1 year ago
3
Dev
#88
JohnGouwar
closed
1 year ago
0
*Do not use* Old development branch
#87
arjunguha
closed
1 year ago
0
Peft automodel support
#86
cassanof
closed
1 year ago
2
Actually uses prompt to make sure not to terminate early.
#85
JohnGouwar
closed
1 year ago
0
Fixed jsonl extraction.
#84
JohnGouwar
closed
1 year ago
0
Results-to-jsonl
#83
JohnGouwar
closed
1 year ago
0
Turn translator into a library
#82
arjunguha
closed
1 year ago
1
Local datasets are JSON arrays, not JSON-L
#81
JohnGouwar
closed
1 year ago
0
First pass on ocaml compiler
#80
JohnGouwar
closed
1 year ago
1
Adds MATLAB to the language suite.
#79
JohnGouwar
closed
1 year ago
4
Add HumanEval+ test generation
#78
Randl
closed
1 year ago
4
Make prompt preparation deterministic
#77
Randl
closed
1 year ago
2
Updated OpenAI Interface
#76
joydeep-b
closed
1 year ago
3
Development branch
#75
arjunguha
closed
1 year ago
1
Fix bugs/slow algos
#74
Randl
closed
1 year ago
5
Fix assert generation for Option in Scala
#73
abhijangda
closed
1 year ago
1
PHP test indexed array comparison
#72
PootieT
opened
1 year ago
0
C# test sequence equality
#71
PootieT
opened
1 year ago
1
allowed for separate tokenizer in automodel
#70
esslushy
closed
1 year ago
0
fixed extension string, added default libs
#69
PootieT
closed
1 year ago
2
Small swift fix
#68
PootieT
closed
1 year ago
0
Perl Unit test comparing float values
#67
PootieT
closed
1 year ago
4
Perl Unit test when expecting "False/0" output
#66
PootieT
opened
1 year ago
5
Strange Scala Unit test Translation for output Tuple Type w/ extra parenthesis
#65
PootieT
opened
1 year ago
4
Scala tests comparing optional value
#64
PootieT
closed
1 year ago
3
Small issues with Swift prompt signatures
#63
PootieT
closed
1 year ago
3
Add HumanEval+ tests
#62
Randl
closed
1 year ago
15
Racket unit test numerical equivalence
#60
PootieT
closed
1 year ago
4
Stop tokens for Java do not allow completions that produce several top-level methods.
#59
PootieT
closed
1 year ago
1
Warning: Bash performance results artificially low
#56
PootieT
closed
1 year ago
5
R unit test comparison between integer and double
#55
PootieT
closed
1 year ago
8
Use atomic vectors in R translation whenever possible
#54
mhyee
closed
1 year ago
1
Append f to float literals in C++, Scala, and C#
#53
abhijangda
closed
1 year ago
2
Previous
Next