search

huggingface / lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
MIT License
831 stars 99 forks source link

Pr sadra #393

Closed clefourrier closed 6 days ago

clefourrier commented 1 week ago

Adapting #241 so that it fits what we need in lighteval. @sadra-barikbin can you tell me if anything's missing?

sadra-barikbin commented 2 days ago

Adapting #241 so that it fits what we need in lighteval. @sadra-barikbin can you tell me if anything's missing?

Sorry I was busy a few days. Looks great. Just a unit test and a docstring typo in prompt_manager.py:92 is left. I'll send a follow-up if you will.

clefourrier commented 1 day ago

Thanks a lot, yes please do :)