Avoid slow testing due to network issues.

EleutherAI / lm-evaluation-harness

A framework for few-shot evaluation of language models.

https://www.eleuther.ai

MIT License

6.9k stars 1.84k forks source link

Avoid slow testing due to network issues. #1824

Open pixeli99 opened 6 months ago

pixeli99 commented 6 months ago

This is just a reminder that in some cases where the network is restricted, please remember to set the environment variable HF_DATASETS_OFFLINE to 1 to enable full offline mode. This will prevent the program from waiting for the datasets' response, which has cost me a lot of time when testing MMLU. Hopefully this is helpful.

haileyschoelkopf commented 5 months ago

This would make a good addition to the documentation / README!

pixeli99 commented 5 months ago

This would make a good addition to the documentation / README!

I will submit a PR, hoping to be of some help.🤖