LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.
MIT License
646
stars
72
forks
source link
`--no_multichoice_continuations_start_space` should also cover startof word token #45
If the tokenizer prepends
_
as sow token, it will make single token evals fail. Reported by @anton-l