The models are all RN50. Can this change to ViT-L or other clip model?

[cjf-repo]

And I have try to change the model to ViT,but have some error,llike the output size and other error, how to solve it?