search

microsoft / tutel

Tutel MoE: An Optimized Mixture-of-Experts Implementation
MIT License
694 stars 84 forks source link

add built-in llama_ffn; add helloworld_custom_expert_sharded; #235

Closed ghostplant closed 3 months ago

ghostplant commented 3 months ago

For https://github.com/microsoft/tutel/issues/226.