search

kingoflolz / mesh-transformer-jax

Model parallel transformers in JAX and Haiku
Apache License 2.0
6.27k stars 890 forks source link

To run multiple model on one model #206

Open whoislimshady opened 2 years ago

whoislimshady commented 2 years ago
  1. Is there any way to run multiple model on one tpu without having to load everytime when i wanted to use any of them 2.Does anyone know how much gpu power it require to run model