huggingface / lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
MIT License
814 stars 98 forks source link

Added inference using litellm #380

Closed JoelNiklaus closed 1 week ago

JoelNiklaus commented 2 weeks ago

This PR enables running inference using any model provider supported by litellm.