Open ShuxunoO opened 9 months ago
Thx, for your interests in this project. It can be very similar to pre-training and here's a suggested steps:
b32_400m
and add `pretrained="metaclip_400m"def b32_400m_ft():
return b32_400m(
pretrained="metaclip_400m", # should download pre-trained MetaCLIP ViT-B/32 400M
)
(we will have a new config system released soon)
train_data
for https://github.com/facebookresearch/MetaCLIP/blob/main/src/training/data.py
and we highly recommend use your own dataloader to control randomness instead of built-in one.
Hello~
How can I finetune the released MetaCLIP models on my own dataset(Img-Txt paires) and how do I organize the data?