search

ROCm / DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
https://www.deepspeed.ai/
Apache License 2.0
4 stars 3 forks source link

Update DeepSpeedExamples commit #55

Closed rraminen closed 2 years ago

rraminen commented 2 years ago

To include scripts to run Megatron-LM GPT2 ZeRO2 model on 16 GPUs from https://github.com/ROCmSoftwarePlatform/DeepSpeedExamples/pull/20