This is the official PyTorch implementation for "Improving Visual Prompt Tuning for Self-supervised Vision Transformers" [ICML 2023].
This repository is heavily based on the official PyTorch implementation of "Visual Prompt Tuning" [ECCV 2022] : KMnp/vpt.
conda create -n [ENV_NAME] python=3.8.12 -y
conda activate [ENV_NAME]
bash env_install.sh
VTAB_SETUP.md
] (in accordance with KMnp/vpt)pretrained checkpoints for MAE, MoCo-v3 should be located in the 'params' folder.
bash run.sh [data_name] [encoder] [batch_size] [base_lr] [num_tokens] [gate_init]
For example for the CUB dataset, execute
bash run.sh cub mae_vitb16 64 0.1 100 5