search

nuprl / MultiPL-E

A multi-programming language benchmark for LLMs
https://nuprl.github.io/MultiPL-E/
Other
201 stars 38 forks source link

fixed extension string, added default libs #69

Closed PootieT closed 1 year ago

PootieT commented 1 year ago

for issue #63

arjunguha commented 1 year ago

Thanks! I want to put out a release of MultiPL-E this week, that is exactly what was used to evaluate StarCoder -- bugs included. After that's out, I'll merge this PR.

arjunguha commented 1 year ago

Thanks!