meta-llama / llama

Inference code for Llama models
Other
56.52k stars 9.58k forks source link

Oddities downloading the 8b-instruct model #1129

Open ppbrown opened 5 months ago

ppbrown commented 5 months ago

I'm running the download.sh script. I specifically select the 8B-instruct model to download

But, it's downloading USE_POLICY and LICENSE files, that are 15GB each in seize.

This seems like a significant bug.

on top of all that... while it successfully granted me access to the initial files, thanks to the key... it failed after downloading SOME of the files.

Saving to: './Meta-Llama-3-8B-Instruct/params.json'

./Meta-Llama-3-8B-Instruct/pa 100%[=================================================>]  14.96G   110MB/s    in 2m 22s

2024-06-09 13:58:40 (108 MB/s) - './Meta-Llama-3-8B-Instruct/params.json' saved [16060617592/16060617592]

--2024-06-09 13:58:40--  https://download6.llamameta.net/8b_instruction_tuned/consolidated.00.pth?Policy=eyJTdGF0ZW1lbnQiOlt7InVuaXF1ZV9oYXNoIjoiZHF0dTFzazRoazZ5ZHRhbXRwZTRrYW90IiwiUmVzb3VyY2UiOiJodHRwczpcL1wvZG93bmxvYWQ2LmxsYW1hbWV0YS5uZXRcLyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE3MTgwNTE4NTh9fX1dfQ__&Signature=i-8agn97iKFPeZQqSOLOvzJcWSIao2QoO8Fr2ZrL-Qeh0HRJFFaFAwKjcbOQcm4DudYWBEroUaQffcdGaaeHihSVj1Y8mGzztlhEm~R4EV~QweReMJ8RBaE37Id~sIps1hZ72jnpbJ6pi9CfTp5qcgF6OLAc-Pg4muHxUSOxfsdupwNK80rH~h8Gypta-~wLCtrz28UofbEkNBIc4FEfWBU62rvxcMl8QeE~hbxNX4C~CUXSbini8gW73BRSWIVk45d6WCSVpWV7iF~1UgkdLpD3xAGeIyvpPu82SguGAerjznHH7PGcpL3aAFDRZb9gjAtMa-VeQ1AR74hnUSUBNg__&Key-Pair-Id=K15QRJLYKIFSLZ&Download-Request-ID=854345456748614
Resolving download6.llamameta.net (download6.llamameta.net)... 18.65.25.37, 18.65.25.52, 18.65.25.69, ...
Connecting to download6.llamameta.net (download6.llamameta.net)|18.65.25.37|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden.
2024-06-09 13:58:40 ERROR 403: Forbidden..