search

shawntan / scattermoe

Triton-based implementation of Sparse Mixture of Experts.
Apache License 2.0
150 stars 10 forks source link

Megablocks example #7

Open ehartford opened 3 months ago

ehartford commented 3 months ago

Can you please provide an example to use ScatterMoE with Megablocks? https://github.com/databricks/megablocks