search

xiaoachen98 / Open-LLaVA-NeXT

An open-source implementation for training LLaVA-NeXT.
240 stars 10 forks source link

Vision Tower #10

Closed homiec closed 2 months ago

homiec commented 2 months ago

I would like to ask, because open-llava-next updated clip-vit during the training process, does the open-sourced weight （ https://huggingface.co/Lin-Chen/open-llava-next-vicuna-7b ） already include the weight of vit?

xiaoachen98 commented 2 months ago

I would like to ask, because open-llava-next updated clip-vit during the training process, does the open-sourced weight （ https://huggingface.co/Lin-Chen/open-llava-next-vicuna-7b ） already include the weight of vit?

Yeah. The fine-tuned weights of ViT will be auto-loaded. You can check it twice before you train the model.