mbzuai-oryx / LLaVA-pp

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
752 stars 53 forks source link

Can't load the HF model #10

Closed vfragoso closed 2 months ago

vfragoso commented 2 months ago

Thanks for the good work! I tried to load the model via HF, but I am getting this error:

image

Any hint as to how to solve this?

Thanks!

mmaaz60 commented 2 months ago

Hi @vfragoso,

Thank you for your interest in our work. Unfortunately, the vision version of Phi-3 is not yet added to the transformers and you have to use our provided code to correctly load the model.

Please try using our Hugging Face Demo. It will be definitely helpful. Thank You.