Can we please get a quickstart guide?

kingoflolz / mesh-transformer-jax

Model parallel transformers in JAX and Haiku

Apache License 2.0

6.26k stars 890 forks source link

Can we please get a quickstart guide? #243

Open tswallen opened 1 year ago

tswallen commented 1 year ago

TPU? Proxy? I just want to docker up and don't know what any of these script will or won't setup automatically. I don't like spending hours of setup to find something doesn't work.

Joseffb commented 1 year ago

Not a quick-start per say but close enough: https://devforth.io/blog/gpt-j-is-a-self-hosted-open-source-analog-of-gpt-3-how-to-run-in-docker/

bouldinnathan commented 1 year ago

Might help. https://www.youtube.com/watch?v=9dIR7g_1hgU&ab_channel=NerdyRodent