bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
781 stars 208 forks source link

MultiPL-E now supports Dart, OCaml, Elixir, Haskell, Clojure #273

Closed arjunguha closed 1 week ago

arjunguha commented 2 weeks ago

After this patch is reviewed, I need to also push an update to the MultiPL-E evaluation container.

For my reference, this is already built on Boa and tagged localhost/evaluation-harness-multiple.

arjunguha commented 1 week ago

New container uploaded