Gemini 1.5/Ultra support

EleutherAI / lm-evaluation-harness

A framework for few-shot evaluation of language models.

https://www.eleuther.ai

MIT License

6.99k stars 1.87k forks source link

Open notrichardren opened 6 months ago

notrichardren commented 6 months ago

Is there an effort right now to add Gemini support to the evaluation harness?

liangzid commented 5 days ago

I also have this problem. Have you solved it? thanks!