huggingface / lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
MIT License
831 stars 99 forks source link

Fix Tokenization + misc fixes #354

Closed hynky1999 closed 1 month ago

hynky1999 commented 1 month ago