search

xiaoachen98 / Open-LLaVA-NeXT

An open-source implementation for training LLaVA-NeXT.
240 stars 10 forks source link

Is the param "self.image_newline" only tuned in SFT? #6

Open huangrh99 opened 3 months ago

huangrh99 commented 3 months ago

I found that the 'self.image_newline' in LlavaMetaModel was not tuned during the pre-training stage. Have you tried enabling this parameter during pre-training?

xiaoachen98 commented 3 months ago

I found that the 'self.image_newline' in LlavaMetaModel was not tuned during the pre-training stage. Have you tried enabling this parameter during pre-training?

I'm busy with some deadlines now. I will check this parameter after theses deadlines.