search

kingoflolz / mesh-transformer-jax

Model parallel transformers in JAX and Haiku
Apache License 2.0
6.29k stars 892 forks source link

Weight download problem #176

Closed paramjeet2021 closed 2 years ago

paramjeet2021 commented 2 years ago

Hi, I am trying to download weights using the command !time wget -c https://the-eye.eu/public/AI/GPT-J-6B/step_383500_slim.tar.zstd

But it keep on trying and does not connect. It seems this link is down and would you let me know when it would be up and possible to download the weights.

paramjeet2021 commented 2 years ago

Any idea, When can I download these weights. I need these weights to execute my script or is there any way to download these weights from some other source?

shimoshida commented 2 years ago

@paramjeet2021 If you want FP16 model, the following mirror server exists; https://archive.org/details/GPT-J-6B-weights

paramjeet2021 commented 2 years ago

I have to fine tune the model with my custom data so would like to have full weights. Is it possible to find full weights , not just the bf16 slim weights?

shimoshida commented 2 years ago

@paramjeet2021 How about this? https://mystic.the-eye.eu/public/AI/GPT-J-6B/

kingoflolz commented 2 years ago

Fixed by #182