search

WalBouss / LeGrad

https://walidbousselham.com/LeGrad/
MIT License
61 stars 6 forks source link

Error with siglip. #3

Open asPagurus opened 4 months ago

asPagurus commented 4 months ago

In your paper you said that you use ViT-B-16 siglip model with webli weights. I try to use ViT-B-16-SigLIP webli but get this error^ AttributeError: 'TimmModel' object has no attribute 'transformer'

I am trying several siglip models but each time get this error.

What I have to do to launch Legrad on siglip models?

M-Salti commented 4 months ago

I was just facing the same error. Turns out you should use compute_legrad_siglip instead of compute_legrad_clip. Or you can use compute_legrad which will route to the appropriate method automatically depending on the model type (clip, siglip, coca). I think the example in the README should use compute_legrad anyway to avoid this error.