search

facebookresearch / MetaCLIP

ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Experts via Clustering
Other
1.17k stars 49 forks source link

Clarification: Does MetaCLIP actually use the updated training method as described in the paper? #46

Closed shelbywhite closed 6 months ago

shelbywhite commented 6 months ago

Does MetaCLIP actually use the updated training method as described in the paper?

According to the readme of this repo it says: "All MetaCLIP adhere to OpenAI CLIP training setup" which implies that MetaCLIP models shown in this repo don't actually leverage the new technique MetaCLIP uses for training the models itself. I hope this is not the case, but would be helpful to clarify what this statement means.

howardhsu commented 5 months ago

what do you mean by "updated training method"? we didn't invent/introduce any "new technique" but follow OpenAI training recipe closely to avoid confounding factors on optimization/lr etc. that was used by other open source CLIP models than comparing to OpenAI CLIPs.