Y-IAB / lm-evaluation-harness

A framework for few-shot evaluation of language models.
https://www.eleuther.ai
MIT License
0 stars 0 forks source link

Load Puree Dataset #17

Closed rifqiyan closed 4 months ago

rifqiyan commented 5 months ago

Currently, LM Evaluation Harness can only use local and HF datasets. Datasets for Yanolja tasks are managed using zip file in Google Drive. We should allow it to access datasets from Puree.