Closed shihuai closed 7 months ago
You can ignore this warning, as the visual encoder will be automatically initialized with CLIP.
Since we don't fine-tune the visual encoder, the original CLIP weights are saved in our model weights. Considering that weights may change slightly when saved, we initialize the visual encoder with the original CLIP instead of the saved model weights.
OK, thanks you for your reply.
I have download the weights file in local directory, but have some problem when load the file.