ROCm / DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
https://www.deepspeed.ai/
Apache License 2.0
4 stars 3 forks source link

Removed megatron-lm from requirements #62

Closed rraminen closed 1 year ago

rraminen commented 1 year ago

This fix is required to avoid the below error during DeepSpeed build

ERROR: Could not find a version that satisfies the requirement megatron-lm==1.1.5 (from deepspeed==0.6.6+828ab71) (from versions: none) ERROR: No matching distribution found for megatron-lm==1.1.5 (from deepspeed==0.6.6+828ab71)

This change is already made in upstream https://github.com/microsoft/DeepSpeed/commit/a094c9763de8d42107cbffd0bb9abb8056aa3c60

https://ontrack-internal.amd.com/browse/SWDEV-397284

pruthvistony commented 1 year ago

Code change to skip UT is not required is it?

rraminen commented 1 year ago

Code change to skip UT is not required is it?

These tests are not present in the current branch to skip.