search

goel-shashank / CyCLIP

111 stars 14 forks source link

Any pretrained checkpoints? #1

Closed voodoohop closed 2 years ago

goel-shashank commented 2 years ago

You can find them here.

bdevnani3 commented 2 years ago

Is the 3M checkpoint the best one available? I'm wondering if I'm missing the 12M checkpoint.

Hritikbansal commented 2 years ago

Table 1 of the paper uses this checkpoint (trained with CC3M data only ~ 2.6M datapoints). CyCLIP-3M checkpoint is used for Figure 4 (trained on 3M datapoints from CC3M and remaining from CC12M).

Unfortunately, we didn't have the resources (compute, bandwidth) to run a CC12M version of our model at the time of the project. We shall see if we can train a CC12M version and will keep a look out for other repos that intend to replicate large scale CLIP models such as https://github.com/LAION-AI/CLIP_benchmark

bdevnani3 commented 2 years ago

Sounds good - thanks for closing the loop so promptly!