Can I do Fine-Tune GPT-J in colab pro?

kingoflolz / mesh-transformer-jax

Model parallel transformers in JAX and Haiku

Apache License 2.0

6.27k stars 890 forks source link

Closed haositongxue closed 2 years ago

haositongxue commented 2 years ago

and Can I use a gdriver to replace gcloud BUCKET? thx

kingoflolz commented 2 years ago

No, colab pro does not provide enough ram or vram