Closed PengNi closed 2 years ago
https://pytorch.org/docs/stable/generated/torch.nn.parallel.DistributedDataParallel.html; https://zhuanlan.zhihu.com/p/350301395; https://zhuanlan.zhihu.com/p/358924078; https://www.aiuai.cn/aifarm1764.html, https://www.telesens.co/2019/04/04/distributed-data-parallel-training-using-pytorch-on-aws/;
see commit 290cf96.
PengNi
commented
2 years ago
https://pytorch.org/docs/stable/generated/torch.nn.parallel.DistributedDataParallel.html; https://zhuanlan.zhihu.com/p/350301395; https://zhuanlan.zhihu.com/p/358924078; https://www.aiuai.cn/aifarm1764.html, https://www.telesens.co/2019/04/04/distributed-data-parallel-training-using-pytorch-on-aws/;