search

EleutherAI / pythia

The hub for EleutherAI's work on interpretability and learning dynamics
Apache License 2.0
2.16k stars 156 forks source link

Missing / undownloadable checkpoints on huggingface #141

Closed mirandrom closed 6 months ago

mirandrom commented 7 months ago

I recently went through downloading the pythia models and found the following models to be undownloadable, either because the branch/revision does not exist, or the branch/revision is missing files. See also #107

https://huggingface.co/EleutherAI/pythia-12b/discussions/3#6571dbb664b404e24bdd2bbd

StellaAthena commented 6 months ago

Thanks for drawing this to our attention. We didn't understand how HF's rate limiting for uploads worked at the time and it caused some issues.

@haileyschoelkopf, flagging this for you.

haileyschoelkopf commented 6 months ago

Hi @mirandrom , I'm very sorry this passed me by--I have now uploaded all missing Pythia-12b checkpoints to HF, and will upload the missing 1b checkpoint shortly once no longer rate limited.

Regarding the step143000 checkpoints, as best I can tell, the listed models do indeed currently have step143000 revisions accessible.

mirandrom commented 6 months ago

Thank you very much!