Open aprilehannibal opened 6 months ago
We don't have that intention while the MoE implementation needs to be driven under Deepspeed engine, which could lead to unfair comparisons. We look forward to having more community institutes working on this.
Describe the issue
MoE的一个优势是推理效率,但是在paper里没看到和同size的VLM做对比,请问具体情况如何?