huggingface / lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
MIT License
814 stars 98 forks source link

Fixes a TypeError for generative metrics. #386

Closed JoelNiklaus closed 1 week ago

JoelNiklaus commented 1 week ago

Fixes the following error for metrics like ter, chrf or bleu.

TypeError: GenerativePreparator.prepare() got multiple values for argument 'golds'.