search

Y-IAB / lm-evaluation-harness

A framework for few-shot evaluation of language models.
https://www.eleuther.ai
MIT License
0 stars 0 forks source link

FileNotFoundError: Unable to find '/home/seungduk/apps/lm-evaluation-harness/./data/yanolja_review_summarization.jsonl' #13

Open seungduk-yanolja opened 7 months ago

seungduk-yanolja commented 7 months ago

wrong access to the data directory

myeongho-jeong-yanolja commented 7 months ago

Yeah, it has some issue when reading dataset path, I'll fix it. Temporarily, you can run evaluation command on lm_eval/tasks/yanolja directory.

myeongho-jeong-yanolja commented 7 months ago

From seungduk's idea, I'll leverage huggingface dataset instead of downloading from google drive.