Eva CLIP model: trained or freezed?

[shkarupa-alex]

Did you trained eva clip model weights or freezed them and trained just mlp adapter?

[mactavish91]

It was frozen during the pre training phase, but we trained its parameters during the instruction tuning phase.

[xmy0916]

@mactavish91 hello，看你们的论文这部分 想请教下，这四个阶段的训练，那个阶段训练了vit的参数呢？

[paulpaul91]

It was frozen during the pre training phase, but we trained its parameters during the instruction tuning phase.

为什么在pretrain阶段freeze图像参数，有没有做过freeze和unfreeze的消融实验