[Question] Is there any Moe checkpoint of Qwen1.5 or Qwen2 released?

PKU-YuanGroup / MoE-LLaVA

Mixture-of-Experts for Large Vision-Language Models

https://arxiv.org/abs/2401.15947

Apache License 2.0

1.92k stars 121 forks source link

[Question] Is there any Moe checkpoint of Qwen1.5 or Qwen2 released? #91

Open double-fire-0 opened 3 weeks ago

double-fire-0 commented 3 weeks ago

Question

Thanks for your great job. I'm looking for a best moe model checkpoint for Chinese. Is there any Moe checkpoint of Qwen1.5 or Qwen2 released? If not, what's the best moe model checkpoint for Chinese current?