bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
710 stars 183 forks source link

Update MultiPL-E docker image #113

Open loubnabnl opened 1 year ago

loubnabnl commented 1 year ago

The published images use a build of the harness that fails for some MultiPL-E languages (was fixed in https://github.com/bigcode-project/bigcode-evaluation-harness/pull/112 and https://github.com/bigcode-project/bigcode-evaluation-harness/pull/99)