search

huggingface / lighteval

LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.
MIT License
471 stars 55 forks source link

Sets a max length for the MATH task #83

Closed clefourrier closed 4 months ago

clefourrier commented 4 months ago

Caps it at 2048 even for models with a much longer context size. Should fix #80