search

LLaVA-VL / LLaVA-NeXT

Apache License 2.0
2.4k stars 167 forks source link

ValueError: Unknown vision tower: google/siglip-so400m-patch14-384 #188

Open taxom-techlead opened 2 weeks ago

taxom-techlead commented 2 weeks ago

Getting ValueError: Unknown vision tower: google/siglip-so400m-patch14-384 on running https://github.com/LLaVA-VL/LLaVA-NeXT/blob/5fbcf27e32935f4e09d6b8b9f8abed4a572240b0/docs/LLaVA_OneVision_Tutorials.ipynb I did these steps before running the code : https://github.com/haotian-liu/LLaVA/issues/1101#issuecomment-1933697654

ChipsICU commented 2 weeks ago

You can download siglip-so400m-patch14-384 from huggingface or modelscope

kun2001github commented 3 days ago

You can download siglip-so400m-patch14-384 from huggingface or modelscope您可以从 huggingface 或 modelscope 下载 siglip-so400m-patch14-384

I downloaded lmms-lab/llava-onevision-qwen2-0.5b-si and google/siglip-so400m-patch14-384， But I don't know where to put it under the path, I want to ask about it.

ChipsICU commented 3 days ago

You can download siglip-so400m-patch14-384 from huggingface or modelscope您可以从 huggingface 或 modelscope 下载 siglip-so400m-patch14-384

I downloaded lmms-lab/llava-onevision-qwen2-0.5b-si and google/siglip-so400m-patch14-384， But I don't know where to put it under the path, I want to ask about it.

Modify config.json under LLaVA ckpt, you can find the path of vision tower