Closed hooxizz closed 1 year ago
Done it. The scripts need to be modified.
@hooxizz what did you modify in the scripts?
Hi @Annusha,
You need to specify a subset (base or new) and you can get the correct results.
For base class:
python train.py \
--root ${DATA} \
--trainer ${TRAINER} \
--dataset-config-file configs/datasets/${DATASET}.yaml \
--config-file configs/trainers/ZS/${CFG}.yaml \
--output-dir output/base2new/train_base/${DATASET}/zero-shot/${TRAINER}/${CFG}/seeds \
--eval-only \
DATASET.SUBSAMPLE_CLASSES base
For new class:
python train.py \
--root ${DATA} \
--trainer ${TRAINER} \
--dataset-config-file configs/datasets/${DATASET}.yaml \
--config-file configs/trainers/ZS/${CFG}.yaml \
--output-dir output/base2new/test_new/${DATASET}/zero-shot/${TRAINER}/${CFG}/seeds \
--eval-only \
DATASET.SUBSAMPLE_CLASSES new
I just copy the modified scripts of mine. You can replace the configs with yours. Just remember to add --eval-only \ and _DATASET.SUBSAMPLECLASSES new.
Hope the answer can help you.
Hi there,
I am newbie in VLMs and want to reproduce CLIP zero-shot baseline.
I follow the INSTALL.md and use command like:
I only get 93.3% acc on caltech101 dataset. The reported accuracy is 95.40% in Table 3 (c). Other datasets also have lower accuracy than reported. Did I miss something? I attach the zero-shot log on caltech101. Thanks in advance!