search

paperswithcode / galai

Model API for GALACTICA
Apache License 2.0
2.67k stars 275 forks source link

Files sizes of models #60

Closed yratof closed 1 year ago

yratof commented 1 year ago

When running and fetching the models, what final file sizes can we expect from each of the available models?

Hugging face shows 9gb for the huge file, but running after PIP, the downloading hasn't stopped for an hour, it just keeps fetching ~9gb files

yratof commented 1 year ago

https://huggingface.co/facebook/galactica-120b/tree/main

~260gb

mkardas commented 1 year ago

Hi @yratof, I just pushed a jupyter notebook (https://github.com/paperswithcode/galai/blob/bf126df3e6cce16b0a893b4d3b0ad0e3ce8a6492/notebooks/Introduction%20to%20Galactica%20Models.ipynb) describing the details, see the Disk Space Requirements Section. In short, each model requires 2x the number of params:

image

~9 GB shown on the HuggingFace hub is just one of 26 shards.

yratof commented 1 year ago

Perfect, I was looking at the standard model originally - I just need to run HUGE on a different SSD. C drive didn't like it so much :D