search

PKU-YuanGroup / MoE-LLaVA

Mixture-of-Experts for Large Vision-Language Models
https://arxiv.org/abs/2401.15947
Apache License 2.0
1.9k stars 121 forks source link

[Question] Pretrain step #73

Closed rlagustmd82 closed 4 months ago

rlagustmd82 commented 4 months ago

Question

I met this error during pretrain step "You are using a model of type phi to instantiate a model of type llava_phi. This is not supported for all configurations of models and can yield errors." How can I resolve this issue?