search

haotian-liu / LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
https://llava.hliu.cc
Apache License 2.0
19.77k stars 2.17k forks source link

[Question] Which version of LAION is used? #1037

Open yash0307 opened 8 months ago

yash0307 commented 8 months ago

Question

Hi,

Which version of LAION is used for pre-training of the MLP/projection layers? Is it 400M, 2B or 5B?

Thank you.

Regards, Yash Patel.

qazasdwsx commented 8 months ago

same question,I tried CLIP-ViT-L-14-laion2B-s32B-b82K & CLIP-ViT-L-14-DataComp.XL-s13B-b90K,not well