search

jy0205 / LaVIT

LaVIT: Empower the Large Language Model to Understand and Generate Visual Content
Other
506 stars 26 forks source link

Question about ViT #7

Closed SihengLi99 closed 10 months ago

SihengLi99 commented 10 months ago

Hi,

Wonderful work! A question about the version of the ViT-G/14 of EVA-CLIP. Could you please give some details about it? Where is it from? Could you please release the code for building this ViT from the original open-sourced weights? Thanks a lot!

Sincerely

jy0205 commented 10 months ago

We use the same code from the original EVA-CLIP repo (only using the EVA-ViT). Please see https://github.com/baaivision/EVA/blob/master/EVA-CLIP/rei/eva_clip/model.py for more details.

SihengLi99 commented 10 months ago

Hi,

There are so many EVA-CLIP versions at https://github.com/baaivision/EVA/tree/master/EVA-CLIP. Could you please tell me which version is used?

Thanks!

jy0205 @.***> 于2023年11月19日周日 20:32写道：

We use the same code from the original EVA-CLIP repo (only using the EVA-ViT). Please see https://github.com/baaivision/EVA/blob/master/EVA-CLIP/rei/eva_clip/model.py for more details.

— Reply to this email directly, view it on GitHub https://github.com/jy0205/LaVIT/issues/7#issuecomment-1817841289, or unsubscribe https://github.com/notifications/unsubscribe-auth/AR4KH4LM2BFYLYTLWH5GPO3YFH36JAVCNFSM6AAAAAA7RAVTZ2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMJXHA2DCMRYHE . You are receiving this because you authored the thread.Message ID: @.***>

jy0205 commented 10 months ago

We use the EVA-01-CLIP Series, the model name is EVA01_CLIP_g_14_plus_psz14_s11B. It can be downloaded from https://huggingface.co/QuanSun/EVA-CLIP/blob/main/EVA01_CLIP_g_14_plus_psz14_s11B.pt

SihengLi99 commented 10 months ago

Thanks for your quick response, this is very helpful!

SihengLi99 commented 10 months ago

OK, Thanks for your quick response, It is very helpful!

jy0205 @.***> 于2023年11月20日周一 17:49写道：

We use the EVA-01-CLIP Series, the model name is EVA01_CLIP_g_14_plus_psz14_s11B. It can be downloaded from https://huggingface.co/QuanSun/EVA-CLIP/blob/main/EVA01_CLIP_g_14_plus_psz14_s11B.pt

— Reply to this email directly, view it on GitHub https://github.com/jy0205/LaVIT/issues/7#issuecomment-1818703683, or unsubscribe https://github.com/notifications/unsubscribe-auth/AR4KH4NXSR2WJFJHKREVRWDYFMRRDAVCNFSM6AAAAAA7RAVTZ2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMJYG4YDGNRYGM . You are receiving this because you authored the thread.Message ID: @.***>