stanford-crfm / helm

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in Holistic Evaluation of Text-to-Image Models (HEIM) (https://arxiv.org/abs/2311.04287).
https://crfm.stanford.edu/helm
Apache License 2.0
1.8k stars 239 forks source link

Switch data storage to HF with revision #2797

Closed potsawee closed 2 weeks ago

potsawee commented 3 weeks ago

Switch data storage of ThaiExam to HF.

It's now linked to ThaiExam v1 (e.g., all splits have 5 examples for in-context learning & fixed broken examples).