Y-IAB / lm-evaluation-harness

A framework for few-shot evaluation of language models.
https://www.eleuther.ai
MIT License
0 stars 0 forks source link

Caching is not working properly. #15

Open myeongho-jeong-yanolja opened 5 months ago

myeongho-jeong-yanolja commented 5 months ago

this repo save caches with dill, but when we try to load, it returns error that the cache file is malformed. I think it is because of non-english texts (such as japanese, korean).