huggingface / evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
https://huggingface.co/docs/evaluate
Apache License 2.0
1.9k stars 235 forks source link

It seems like evaluate.load doesnt use #561

Open anhq-nguyen opened 4 months ago

anhq-nguyen commented 4 months ago

It seems like evaluate.load doesnt use cache_dir to load local files at all.

I loaded the squad metric with internet and cache_dir argument used. And then tried again with out internet but evaluate.load encounter file squad.py not found error.