download.sh returns 403 forbidden error

[DrewWalkup]

What's Happening When attempting to download the 70B-chat model using download.sh, the model itself returns a 403 forbidden code.

Traceback *Note the the policy has been removed to maintain security.

Downloading llama-2-70b-chat
--2023-07-18 14:56:00--  https://download.llamameta.net/llama-2-70b-chat/consolidated.00.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.110, 18.155.202.78, 18.155.202.88, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.110|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:00 ERROR 403: Forbidden.

--2023-07-18 14:56:00--  https://download.llamameta.net/llama-2-70b-chat/consolidated.01.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.78, 18.155.202.110, 18.155.202.51, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.78|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:00 ERROR 403: Forbidden.

--2023-07-18 14:56:00--  https://download.llamameta.net/llama-2-70b-chat/consolidated.02.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.51, 18.155.202.78, 18.155.202.88, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.51|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:00 ERROR 403: Forbidden.

--2023-07-18 14:56:00--  https://download.llamameta.net/llama-2-70b-chat/consolidated.03.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.110, 18.155.202.78, 18.155.202.51, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.110|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:01 ERROR 403: Forbidden.

--2023-07-18 14:56:01--  https://download.llamameta.net/llama-2-70b-chat/consolidated.04.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.51, 18.155.202.88, 18.155.202.110, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.51|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:01 ERROR 403: Forbidden.

--2023-07-18 14:56:01--  https://download.llamameta.net/llama-2-70b-chat/consolidated.05.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.88, 18.155.202.78, 18.155.202.51, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.88|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:01 ERROR 403: Forbidden.

--2023-07-18 14:56:01--  https://download.llamameta.net/llama-2-70b-chat/consolidated.06.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.88, 18.155.202.110, 18.155.202.78, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.88|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:01 ERROR 403: Forbidden.

--2023-07-18 14:56:01--  https://download.llamameta.net/llama-2-70b-chat/consolidated.07.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.78, 18.155.202.51, 18.155.202.110, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.78|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:01 ERROR 403: Forbidden.

--2023-07-18 14:56:01--  https://download.llamameta.net/llama-2-70b-chat/params.json?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.110, 18.155.202.88, 18.155.202.51, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.110|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:01 ERROR 403: Forbidden.

--2023-07-18 14:56:01--  https://download.llamameta.net/llama-2-70b-chat/checklist.chk?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.51, 18.155.202.88, 18.155.202.78, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.51|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:02 ERROR 403: Forbidden.

Checking checksums
md5sum: checklist.chk: no properly formatted MD5 checksum lines found

Steps to Reproduce git clone https://github.com/facebookresearch/llama.git cd to_llama_directory source download.sh enter URL enter '70B-chat' as model to download

[blevlabs]

Just tried 'source' with my download.sh script and got the same issue.

[rolandtannous]

yes same problem here

[alexanderfrey]

same here

[rwade42]

Same :(

[ai8hyf]

same

[wtfbbqhax]

same

[zitterbewegung]

I am also getting errors saying 403 forbidden.

[realhaik]

Yes, the download URL that is sent in the email returns 403

<Error>
<Code>AccessDenied</Code>
<Message>Access Denied</Message>
<RequestId>SKYPWV0JXM2WGX0E</RequestId>
<HostId>/FrUedRqzYAjkmRLenU0MYosC5qR+q27LR2WWh09+NNqSXnGXhJTP2V8Y8a1aryGUVFenNLbLBI=</HostId>
</Error>

[tensorboy]

Same issues

[efraisse]

checkout @MIBlue119's comment under issue #370, it worked for me, he said: """ @thewilltejeda / @joshvfleming Try to a. remove the llama directory b. reclone the repo c. resent the request to https://ai.meta.com/resources/models-and-libraries/llama-downloads/ again to get the new link d. cd llama e. chmod 755 download.sh f. copy the url from the newest email to the ./download.sh """

[rolandtannous]

already sent another request.. didn't get a link yet

[jxy]

Downloading LICENSE, USE_POLICY.md, tokenizer.model, and tokenizer_checklist.chk are fine, but downloading any model specific files gives 403 forbidden.

[khushpatelmd]

facing 403 forbidden error. Requested a link again and had the same issue.

[bdambrosio]

me too. sigh

[pyamin1878]

same same same

[pyamin1878]

It downloaded 5 items, and then restricted from downloading models.

[sivang]

getting this to all model downloads...

Also getting this, it'd be nice if someone from Meta could chip in and provide some insight to this. thanks

[jpfyoder]

Same issue here.

[MatthewNicastro]

I did what was suggested by @efraisse and it semi worked. The non-chat models seem to fail, but the chat ones work just fine. I think this might be a server issue

[keceli]

Make sure the URL text you paste starts with: https://download.llamameta.net/. If it starts with: https://l.facebook.com/ it doesn't work.

[shi-kejian]

I fixed it by:

1. Only manually copy (ctrl+c or cmd+c) the URL text in the email. Don't do "copy link"
2. if 403 still occur, request a link again. I got an immediate 2nd approval.

It seems my 2nd approval link works 🎉, use it asap but the first one doesn't.

Also see issue #350 and #351

[taf2]

@shi-kejian this didn't work for me... :(

chmod a+x ./download.sh
./download.sh

I'm 90% certain they have an encoding issue in the link they send out... so based on the hash they generate some people will get a broken link some maybe get a good link.

[faizansid77]

I am also facing the same issue

[sumeetshirgure]

Same issue

[faizansid77]

Requesting another link and downloading models one-by-one works for me

[lallousx86]

Same problem. I managed to download the non chat models, no problems. All of them. The chat models give an error.

Nothing but problems downloading today. On my second requested link and trying to get this silly thing to work.

What's funny is that Meta engineers think we are babies: "Oh, maybe you paste the wrong email link", "Oh, maybe you also copied the 'Select' word on the second line", "Oh, don't use the redirect link" ...

Meta, fix your stuff....

And thanks for your contribution.

[akashocx17]

Same stuff!! requesting again

[blevlabs]

checkout @MIBlue119's comment under issue #370, it worked for me, he said: """ @thewilltejeda / @joshvfleming Try to a. remove the llama directory b. reclone the repo c. resent the request to https://ai.meta.com/resources/models-and-libraries/llama-downloads/ again to get the new link d. cd llama e. chmod 755 download.sh f. copy the url from the newest email to the ./download.sh """

I got the new URL from a second request and followed the steps above from another commenter and now I can successfully download the models

[taf2]

I can report getting a new link and starting by just downloading '13b' seems to work. Unsure if the 70b-chat will work

Interesting in my output for 13b i see one request 403'd and one is downloading... this could just be ratelimits on their servers preventing downloads?

https://download.llamameta.net/llama-2-13b/consolidated.00.pth -> 403'ed while https://download.llamameta.net/llama-2-13b/consolidated.01.pth -> is downloading fine.

Here's the final output:

Checking checksums
consolidated.00.pth: FAILED
consolidated.01.pth: OK
params.json: OK
md5sum: WARNING: 1 computed checksum did NOT match

running a second time and everything fails with just:

Checking checksums
md5sum: checklist.chk: no properly formatted checksum lines found

[blevlabs]

I can report getting a new link and starting by just downloading '13b' seems to work. Unsure if the 70b-chat will work

Interesting in my output for 13b i see one request 403'd and one is downloading... this could just be ratelimits on their servers preventing downloads?

https://download.llamameta.net/llama-2-13b/consolidated.00.pth -> 403'ed while

https://download.llamameta.net/llama-2-13b/consolidated.01.pth -> is downloading fine.

Here's the final output:

Checking checksums

consolidated.00.pth: FAILED

consolidated.01.pth: OK

params.json: OK

md5sum: WARNING: 1 computed checksum did NOT match

running a second time and everything fails with just:

Checking checksums

md5sum: checklist.chk: no properly formatted checksum lines found

I am getting the same - its getting a lot of 403s but its downloading something... Hopefully the models wont just be partially downloaded and they will be functional.

[taf2]

@blevlabs it's the same 403 issue - their servers are doing something most likely rate limts but then the files get corrupted and will forever fail.... unless you nuke the model dir... so first since this is very flaky... back things up:

cp -R rm  llama-2-13b/*   13b-backup/
rm -rf rm  llama-2-13b/*
./download.sh
...
13B

for example after many iterations:

2023-07-18 20:47:19 (5.65 MB/s) - ‘./llama-2-13b-chat/checklist.chk’ saved [154/154]

Checking checksums
consolidated.00.pth: OK
consolidated.01.pth: OK
params.json: OK

keep trying until great success.. .hopefully someone will post a torrent file to improve this process soon.

[blevlabs]

Yeah, the only one I could successfully download was Llama-2-7B, all the others are giving me the 403 forbidden issue

[MIBlue119]

@blevlabs You could try to download one by one with modifying the ./download.sh I meet the same issue with you when i try to download all models. But when i set one model to download, it is worked for me.

[blevlabs]

@MIBlue119 Interesting, Ill have to retry. I tried to select just a few models, then just 13B, or the chat version, 7b-chat, and still ran into the 403 issues. Perhaps I need a third link, or wait a bit if there are any limits on one URL can make.

[taf2]

I can confirm if you get a 403 request a new link...

if you have output like:

2023-07-18 21:08:47 (45.6 MB/s) - ‘./llama-2-70b-chat/checklist.chk’ saved [478/478]

Checking checksums
consolidated.00.pth: OK
consolidated.01.pth: OK
consolidated.02.pth: OK
consolidated.03.pth: FAILED
consolidated.04.pth: OK
consolidated.05.pth: FAILED
consolidated.06.pth: OK
consolidated.07.pth: FAILED
params.json: OK

Then get the new link and do this:

 wget 'https://download.llamameta.net/llama-2-70b-chat/consolidated.05.pth?Policy=(insert new hash)'

rinse and repeat. it's a FB bug

[dseddah]

Hi everyone, I'm still having that 403 error ;( I requested a new key and still the same errors. I've tried downloading some of them but to no luck.

Anyone with a workaround ? I requested access via hugginface but they ask to require access for each of them...

[datanizing]

For me it was a problem of .wgetrc. Try to (re)move that file and try it again. Worked immediately.

[stawils]

still 403 forbidden error. requested new link.....still waiting.

Resolving download.llamameta.net (download.llamameta.net)... 3.160.212.115, 3.160.212.113, 3.160.212.74, ... Connecting to download.llamameta.net (download.llamameta.net)|3.160.212.115|:443... connected. HTTP request sent, awaiting response... 403 Forbidden. ERROR 403: Forbidden..

[chrismarra]

Hi everyone, we fixed some issues with the download links yesterday - resetting your local directory and requesting a new link is the best way to start over unless you've already verified checksums and know exactly which files you need.

When you post 403s, please include the time at which you received the email so we can check whether all fixes were applied or not.

[dseddah]

Hi everyone, we fixed some issues with the download links yesterday - resetting your local directory and requesting a new link is the best way to start over unless you've already verified checksums and know exactly which files you need.

When you post 403s, please include the time at which you received the email so we can check whether all fixes were applied or not.

Hi, here's mine (Paris time, CEST+1) -2023-07-19 15:08:45-- https://download.llamameta.net/llama-2-7b/checklist.chk?Policy=eyJTdGF0ZW1l(...)d9fX1dfQ__&Signature=IHTP9JLmj7yunwW1%7EsgyHZKs5RUfprt5Mn2yqeP408fl9OIM7WaRRqYzHFxMeM2Ce3x41fToFqB0uOlhJxRYw4r4AvlRtwHPmzNA-gg7aD3SQePPwe4ghWkfn4v-3jlbkRLwj5__(....)___Q__&Key-Pair-Id=K15Q_[...]_LZ Resolving download.llamameta.net (download.llamameta.net)... 18.164.52.48, 18.164.52.8, 18.164.52.57, ... Connecting to download.llamameta.net (download.llamameta.net)|18.164.52.48|:443... connected. HTTP request sent, awaiting response... 403 Forbidden. 2023-07-19 15:08:45 ERROR 403: Forbidden..

that's the second key I've been requesting. (first on my inria account and then on gmail). I got it at 2.31am ( Paris time, CEST+1)

Thanks for looking into that.

Best, Djamé

[datanizing]

Can you the link from the email in the browser? Then I would be almost sure that it is related to .wgetrc

Going back to the old .wgetrc revived the problem for me, I also only get ERROR 403: Forbidden.. even when wgettin the supplied link.

Without a .wgetrc the whole download ran without any problem.

[realhaik]

Hi everyone, we fixed some issues with the download links yesterday - resetting your local directory and requesting a new link is the best way to start over unless you've already verified checksums and know exactly which files you need.

When you post 403s, please include the time at which you received the email so we can check whether all fixes were applied or not.

Was this necessary, all this funky download link generation nonsense? What have you achieved with this, except from harassing your users? I have already went thru 3 downloads links, and now waiting for the forth one. I hope you don't block me after the 5th attempt, like you said you would. Thanks!

[dseddah]

I don't have any ~/.wgetrc

[blevlabs]

I got a new key from facebook today, and it seems to work great. Maybe this was just an issue with yesterdays keys?

[rjalexa]

Tried all suggestions in this thread, including zapping the llama directory and re-cloning it from github AND requesting a new DL link from Meta (which thankfully arrives pretty immediately). Do not have any .wgetrc file anywhere. Still get the following errors (Central Europe Daylight time):

Enter the list of models to download without spaces (7B,13B,70B,7B-chat,13B-chat,70B-chat), or press Enter for all: 13B
Downloading LICENSE and Acceptable Usage Policy
--2023-07-25 11:45:45--  https://download.llamameta.net/LICENSE?Policy=eyJTdGF0ZW1lbnQiOlt7InVuaXF1ZV9oYXNoIjoiPzt5Pz9nZT8iLCJSZXNvdXJjZSI6Imh0dHBzOlwvXC9kb3dubG9hZC5sbGFtYW1ldGEubmV0XC8qIiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNjkwMzY0NjUwfX19XX0_&Signature=CnrrzLPc3eKhcBfcmi%7E-CSAje%7EJL6OWHI-i5886srGbPclOddeD3ljK0Q2zGF52BlJKlc6WUIh9cxpPb8FYK-Gx0I9I2Gqe1fInzWjwmTa0fDOhKPMSjRi5Krxxm7WywIVbBkRYRlkNx8hH0Q-2SwE2srjvy3wdW-bibHofF-7Yf2-d3vXcCcF1Yyq0F2Xqe86%7Eyq8zVbroHolzkExSCengNN03nz7XLXG62Ove4WEezdOXEjcgVLH-N0oiQOfLKZWGkCo%7EhRlC3UtlLSgSzEUBEQpWTPdNdJbjSVdVk-P%7Eyi6CtUCpgyEMrV42Xp6b4L2uu%7Ehy6btPHe6J-dl1qWA__&Key-Pair-Id=K15QRJLYKIFSLZ
Resolving download.llamameta.net (download.llamameta.net)... 54.192.111.67, 54.192.111.6, 54.192.111.49, ...
Connecting to download.llamameta.net (download.llamameta.net)|54.192.111.67|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-25 11:45:45 ERROR 403: Forbidden.

--2023-07-25 11:45:45--  https://download.llamameta.net/USE_POLICY.md?Policy=eyJTdGF0ZW1lbnQiOlt7InVuaXF1ZV9oYXNoIjoiPzt5Pz9nZT8iLCJSZXNvdXJjZSI6Imh0dHBzOlwvXC9kb3dubG9hZC5sbGFtYW1ldGEubmV0XC8qIiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNjkwMzY0NjUwfX19XX0_&Signature=CnrrzLPc3eKhcBfcmi%7E-CSAje%7EJL6OWHI-i5886srGbPclOddeD3ljK0Q2zGF52BlJKlc6WUIh9cxpPb8FYK-Gx0I9I2Gqe1fInzWjwmTa0fDOhKPMSjRi5Krxxm7WywIVbBkRYRlkNx8hH0Q-2SwE2srjvy3wdW-bibHofF-7Yf2-d3vXcCcF1Yyq0F2Xqe86%7Eyq8zVbroHolzkExSCengNN03nz7XLXG62Ove4WEezdOXEjcgVLH-N0oiQOfLKZWGkCo%7EhRlC3UtlLSgSzEUBEQpWTPdNdJbjSVdVk-P%7Eyi6CtUCpgyEMrV42Xp6b4L2uu%7Ehy6btPHe6J-dl1qWA__&Key-Pair-Id=K15QRJLYKIFSLZ
Resolving download.llamameta.net (download.llamameta.net)... 54.192.111.6, 54.192.111.49, 54.192.111.29, ...
Connecting to download.llamameta.net (download.llamameta.net)|54.192.111.6|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-25 11:45:45 ERROR 403: Forbidden.

Downloading tokenizer
--2023-07-25 11:45:45--  https://download.llamameta.net/tokenizer.model?Policy=eyJTdGF0ZW1lbnQiOlt7InVuaXF1ZV9oYXNoIjoiPzt5Pz9nZT8iLCJSZXNvdXJjZSI6Imh0dHBzOlwvXC9kb3dubG9hZC5sbGFtYW1ldGEubmV0XC8qIiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNjkwMzY0NjUwfX19XX0_&Signature=CnrrzLPc3eKhcBfcmi%7E-CSAje%7EJL6OWHI-i5886srGbPclOddeD3ljK0Q2zGF52BlJKlc6WUIh9cxpPb8FYK-Gx0I9I2Gqe1fInzWjwmTa0fDOhKPMSjRi5Krxxm7WywIVbBkRYRlkNx8hH0Q-2SwE2srjvy3wdW-bibHofF-7Yf2-d3vXcCcF1Yyq0F2Xqe86%7Eyq8zVbroHolzkExSCengNN03nz7XLXG62Ove4WEezdOXEjcgVLH-N0oiQOfLKZWGkCo%7EhRlC3UtlLSgSzEUBEQpWTPdNdJbjSVdVk-P%7Eyi6CtUCpgyEMrV42Xp6b4L2uu%7Ehy6btPHe6J-dl1qWA__&Key-Pair-Id=K15QRJLYKIFSLZ
Resolving download.llamameta.net (download.llamameta.net)... 54.192.111.49, 54.192.111.29, 54.192.111.67, ...
Connecting to download.llamameta.net (download.llamameta.net)|54.192.111.49|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-25 11:45:45 ERROR 403: Forbidden.

--2023-07-25 11:45:45--  https://download.llamameta.net/tokenizer_checklist.chk?Policy=eyJTdGF0ZW1lbnQiOlt7InVuaXF1ZV9oYXNoIjoiPzt5Pz9nZT8iLCJSZXNvdXJjZSI6Imh0dHBzOlwvXC9kb3dubG9hZC5sbGFtYW1ldGEubmV0XC8qIiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNjkwMzY0NjUwfX19XX0_&Signature=CnrrzLPc3eKhcBfcmi%7E-CSAje%7EJL6OWHI-i5886srGbPclOddeD3ljK0Q2zGF52BlJKlc6WUIh9cxpPb8FYK-Gx0I9I2Gqe1fInzWjwmTa0fDOhKPMSjRi5Krxxm7WywIVbBkRYRlkNx8hH0Q-2SwE2srjvy3wdW-bibHofF-7Yf2-d3vXcCcF1Yyq0F2Xqe86%7Eyq8zVbroHolzkExSCengNN03nz7XLXG62Ove4WEezdOXEjcgVLH-N0oiQOfLKZWGkCo%7EhRlC3UtlLSgSzEUBEQpWTPdNdJbjSVdVk-P%7Eyi6CtUCpgyEMrV42Xp6b4L2uu%7Ehy6btPHe6J-dl1qWA__&Key-Pair-Id=K15QRJLYKIFSLZ
Resolving download.llamameta.net (download.llamameta.net)... 54.192.111.29, 54.192.111.67, 54.192.111.6, ...
Connecting to download.llamameta.net (download.llamameta.net)|54.192.111.29|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-25 11:45:45 ERROR 403: Forbidden.

[Yuiceee]

I obtained the new URL from metaAI, and that resolved the issue.

[karkeranikitha]

I got a new URL from metaAI and changed download.sh permissions as mentioned below chmod 755 download.sh

This resolved 403 error for me

[aswnss-m]

My problem got solved when I ran the download.sh file directly without using sh

sudo chmod +x ./download.sh
./download.sh

This fixed the problem for me

[cooltheo]

Here are my solution Request this URL twice [https://ai.meta.com/resources/models-and-libraries/llama-downloads/](url). It works well now. Good luck~

[rancheng]

in the email, they said

The unique custom URL provided will remain valid for model downloads for 24 hours, and requests can be submitted multiple times. Now you’re ready to start building with Llama 2.