search

huggingface / lighteval

LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.
MIT License
467 stars 54 forks source link

`LatexTableWriter` created but never used. #151

Open PhilipMay opened 2 months ago

PhilipMay commented 2 months ago

In this line a latex writer is created but never used later. Some functionality seems to be missing.

https://github.com/huggingface/lighteval/blob/996b50427b136c347029f6ed1379a05250029c16/src/lighteval/evaluator.py#L143

clefourrier commented 2 months ago

Yep, we need to either remove it or add the option to use the latex export at save time, thanks for noticing (it was mostly a debug/internal option)