huggingface / lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
MIT License
690 stars 78 forks source link

Tidy up dependency groups #81

Closed lewtun closed 7 months ago

lewtun commented 7 months ago

This PR reorganises the dependency groups so that things like ruff and pytest are not part of the core library. This is how we do it in the other HF libs and is important because when these utilities are pinned to specific versions, it is not simple to integrate lighteval within another codebase / environment where the versions can clash.

One added bonus, is that one can now just define:

pip install -e '.[dev]'

to get the core set of dependencies during development :)