search

microsoft / Tutel

Tutel MoE: An Optimized Mixture-of-Experts Implementation
MIT License
724 stars 93 forks source link

fix llama_ffn forward function #245

Closed pingzhili closed 2 months ago

pingzhili commented 2 months ago
ghostplant commented 2 months ago

LGTM! Thanks!