search

microsoft / tutel

Tutel MoE: An Optimized Mixture-of-Experts Implementation
MIT License
694 stars 84 forks source link

enable message size larger than 4GB for all_to_all_v/all_gather_v #228

Closed ghostplant closed 4 months ago