mbzuai-oryx / PALO

(WACV 2025) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, Bengali and Urdu.
Apache License 2.0
77 stars 5 forks source link

loading pretrained models using transformers library #3

Open daria-lioubashevski opened 6 months ago

daria-lioubashevski commented 6 months ago

Hi,

I'm really excited to try your pretrained models, but it seems they haven't been integrated into the transformers library yet. I tried loading MBZUAI/PALO-7B using both the "image-to-text" pipeline and using AutoModel with the latest version of transformers (v4.39.3) and got this error: The checkpoint you are trying to load has model typepalobut Transformers does not recognize this architecture

Am I missing something? Thanks!