search

EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval
https://lmms-lab.github.io/
Other
1.78k stars 137 forks source link

ConnectionError: Couldn't reach 'lmms-lab/ScienceQA' on the Hub (ProxyError) #154

Open xmu-xiaoma666 opened 3 months ago

xmu-xiaoma666 commented 3 months ago

Before you open an issue, please check if a similar issue already exists or has been closed before.

When you open an issue, please be sure to include the following

When I run lmms-eval for scienceqa-img, I face such issue: ConnectionError: Couldn't reach 'lmms-lab/ScienceQA' on the Hub (ProxyError)

Thank you for your contributions!

shanes-cerebras commented 3 months ago

I'm running into an issue downloading ScienceQA as well. Specifically, I'm getting a 502 Server Error. This happens when I try and download using the huggingface-cli directly too, so it definitely seems like some files might be missing/corrupted on the huggingface side.

arnaudstiegler commented 2 months ago

Just tested: huggingface-cli download --repo-type dataset lmms-lab/ScienceQA which is working fine. They had some issues with datasets about 1-2 weeks ago, might be related