search

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
702 stars 180 forks source link

Move code_eval metric from Evaluate to BigCode-eval-harness #156

Closed thomwolf closed 8 months ago

thomwolf commented 8 months ago

This make it simpler to debug and edit the code-eval metric