xiaoachen98 / Open-LLaVA-NeXT

An open-source implementation for training LLaVA-NeXT.
398 stars 20 forks source link

Vision Tower #10

Closed homiec closed 5 months ago

homiec commented 5 months ago

I would like to ask, because open-llava-next updated clip-vit during the training process, does the open-sourced weight ( https://huggingface.co/Lin-Chen/open-llava-next-vicuna-7b ) already include the weight of vit?

xiaoachen98 commented 5 months ago

I would like to ask, because open-llava-next updated clip-vit during the training process, does the open-sourced weight ( https://huggingface.co/Lin-Chen/open-llava-next-vicuna-7b ) already include the weight of vit?

Yeah. The fine-tuned weights of ViT will be auto-loaded. You can check it twice before you train the model.