Run LM Evaluation Harness on VESSL AI

Y-IAB / lm-evaluation-harness

A framework for few-shot evaluation of language models.

https://www.eleuther.ai

MIT License

0 stars 0 forks source link

Run LM Evaluation Harness on VESSL AI #16

Closed rifqiyan closed 4 months ago

rifqiyan commented 5 months ago

We are currently only running evaluations on the on-premise cluster. It will be great if we can leverage additional computing power available on GCP through VESSL AI.