search

EleutherAI / lm-evaluation-harness

A framework for few-shot evaluation of language models.
https://www.eleuther.ai
MIT License
6.41k stars 1.69k forks source link

choices of verbosity in simple_evaluate #2134

Open sidhantls opened 1 month ago

sidhantls commented 1 month ago

In simple_evaluate, what are the choices for verbosity? It's not mentioned in the function documentation. Currently, it is at "INFO" by default. Is there a verbosity level below this? INFO level prints out the model, progress bar etc.

sorobedio commented 1 month ago

did you solve the issue? i am facing a similar issue where I prefer not to have verbose because too unwanted logs

LSinev commented 1 month ago

You can try these levels: https://docs.python.org/3.8/library/logging.html#levels ERROR in particular