add transformers model to be used as judge

huggingface / lighteval

LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.

MIT License

467 stars 54 forks source link

add transformers model to be used as judge #153

Open NathanHB opened 2 months ago

clefourrier commented 2 months ago

Will need to follow the same approach as https://github.com/huggingface/lighteval/pull/146

anilaltuner commented 2 months ago

Hey @clefourrier! I'll build that one if no assignee for now