Ucas-HaoranWei / Vary-toy

Official code implementation of Vary-toy (Small Language Model Meets with Reinforced Vision Vocabulary)
565 stars 41 forks source link

麻烦问一下,qwen 1.8B用的是chat版本的还是非chat版本的? #19

Open duchenzhuang opened 5 months ago

duchenzhuang commented 5 months ago

如题

Ucas-HaoranWei commented 5 months ago

我用的chat

John-Ge commented 4 months ago

请问从原文来看是在pretrain阶段用了qwen的template进行训练的,是没有llava那种用plain template进行pretrain的阶段的是吧