huggingface / lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
MIT License
814 stars 98 forks source link

Fix metric error #384

Closed JoelNiklaus closed 1 week ago

JoelNiklaus commented 1 week ago

Fixes the following error for metrics like ter, chrf or bleu.

TypeError: GenerativePreparator.prepare() got multiple values for argument 'golds'.