Closed Tengxu-Sun closed 3 years ago
@shjwudp Let's also add old torchelastic launcher in bagua/distributed
.
@shjwudp Let's also add old torchelastic launcher in
bagua/distributed
.
Maybe we can try to upgrade pytorch first, let's discuss it first @Tengxu-Sun
pytorch upgrade is possible, the issue is closed.
Now the Elastic Training needs the version of pytorch >= 1.9.0. However, there are some situations where torch version is previous than that. So can we consider this function adapting to the previous version of pytorch?