search

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
710 stars 183 forks source link

Add HumanEvalPack, QuixBugs, Python Bugs, Parity #120

Closed Muennighoff closed 11 months ago

Muennighoff commented 11 months ago

Old PR: https://github.com/bigcode-project/bigcode-evaluation-harness/pull/47

loubnabnl commented 11 months ago

Looks good! feel free to merge