MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud - Githubissues

pentium3 / sys_reading

system paper reading notes

236 stars 12 forks source link

MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud #223

Open pentium3 opened 1 year ago

pentium3 commented 1 year ago

https://assets.amazon.science/91/24/e70af54449d8aa88f6127ab7cce2/mics-near-linear-scaling-for-training-gigantic-model-on-public-cloud.pdf