bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
830 stars 219 forks source link

Update MultiPL-E to v3 prompts #254

Closed arjunguha closed 4 months ago

arjunguha commented 4 months ago

I've put together a new MultiPL-E release, v3 and this updates the harness to point to the new prompts.

There are fixes to old prompts as well as support for new languages, both described on the MultiPL-E dataset page. The nature of fixes is that some PLs have their scores go up a little. I've tested with with StarCoder2-15B (using VLLM) and will continue testing other models.

v3 also addresses the remote-code issue. There won't be warnings any more when using MultiPL-E.