search

PKU-YuanGroup / MoE-LLaVA

Mixture-of-Experts for Large Vision-Language Models
https://arxiv.org/abs/2401.15947
Apache License 2.0
1.9k stars 121 forks source link

[Question] how to visualize routing distribution ? #55

Closed koda-11 closed 5 months ago

koda-11 commented 6 months ago

Question

can you share the code to visualize routing distribution like Fig. 4 and 5 in paper?

thanks!

koda-11 commented 5 months ago

i found https://github.com/PKU-YuanGroup/MoE-LLaVA/blob/main/docs/VISUALIZATION.md