Add config files for models

huggingface / lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

MIT License

689 stars 78 forks source link

Closed clefourrier closed 6 months ago

clefourrier commented 6 months ago

Allows to provide models in 2 ways:

with the CLI, for very basic parameters, using --model_args only (will allow people to give a quick try to the lib, and the test suite to still work)
with individual model files.

Todos:

Fix #128

clefourrier commented 6 months ago

I think it comes from the merge I did this morning, will investigate, ty

clefourrier commented 6 months ago

Should be good :D