Which version of clip-vit-large-patch14 is used?

SkunkworksAI / BakLLaVA

Apache License 2.0

680 stars 46 forks source link

Open attnmamba opened 5 months ago

attnmamba commented 5 months ago

Does Bakllava checkpoints uses openai/clip-vit-large-patch14 or openai/clip-vit-large-patch14-336 as the vision tower?

In finetune_lora.sh, it uses --vision_tower openai/clip-vit-large-patch14.

In finetune.sh, it uses --vision_tower openai/clip-vit-large-patch14-336.

floschne commented 3 months ago

@pharaouk , do you have any updates here?

pharaouk commented 3 months ago

--vision_tower openai/clip-vit-large-patch14-336