LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.
When no generation size is set, we want to use the max generation size possible according to the model (the model.max_length).
This should also fix the bug in #73 .
Also includes a small duplicate removal of TaskConfig
When no generation size is set, we want to use the max generation size possible according to the model (the model.max_length). This should also fix the bug in #73 .
Also includes a small duplicate removal of TaskConfig