PKU-YuanGroup / MoE-LLaVA

Mixture-of-Experts for Large Vision-Language Models
https://arxiv.org/abs/2401.15947
Apache License 2.0
1.9k stars 121 forks source link

[Feature request] Support Llama3 #71

Open xiweideng opened 4 months ago

xiweideng commented 4 months ago

feature

Could you please support Llama3 in MoE-Llava ?