extend parallel_type to use dp without a2a - Githubissues

microsoft / tutel

Tutel MoE: An Optimized Mixture-of-Experts Implementation

MIT License

710 stars 85 forks source link

extend parallel_type to use dp without a2a #183

Closed ghostplant closed 2 years ago