huggingface / lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
MIT License
689 stars 78 forks source link

Homogeneize logging system #118

Closed clefourrier closed 2 months ago

clefourrier commented 6 months ago

At the moment, we have two ways of managing logging, depending on whether we come from nanotron or accelerate models. Nanotron use tensorboard for ex, which accelerate does not