always use torch.distributed.run in new torch versions - Githubissues

microsoft / tutel

Tutel MoE: An Optimized Mixture-of-Experts Implementation

MIT License

694 stars 84 forks source link

always use torch.distributed.run in new torch versions #208

Closed ghostplant closed 1 year ago