add cosine router; add load loss and importance loss - Githubissues

microsoft / tutel

Tutel MoE: An Optimized Mixture-of-Experts Implementation

MIT License

710 stars 85 forks source link

add cosine router; add load loss and importance loss #155

Closed zeliu98 closed 2 years ago