huggingface / evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
https://huggingface.co/docs/evaluate
Apache License 2.0
1.98k stars 255 forks source link

Cannot use it offline! #567

Open SirryChen opened 6 months ago

SirryChen commented 6 months ago

Is there any need to do this func [_download_additional_modules]????? image

SirryChen commented 6 months ago

Despite I have download the metrics and use [evaluate.load('./metrics/bleu')], there is a high chance that it will attempt to connect to the network and download additional modules. What confuses me the most is that it doesn't necessarily trigger network downloads, but rather with a high probability, which is very strange for a fixed piece of code.