[CVPR2024] Simple Semantic-Aided Few-Shot Learning

This is the official pytorch implementation of CVPR 2024 paper ["Simple Semantic-Aided Few-Shot Learning"] [paper] [ArXiv]. If you use any content of this repo for your work, please cite the following bib entry:

@InProceedings{Zhang_2024_CVPR,
    author    = {Zhang, Hai and Xu, Junzhe and Jiang, Shanlin and He, Zhenan},
    title     = {Simple Semantic-Aided Few-Shot Learning},
    booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    month     = {June},
    year      = {2024},
    pages     = {28588-28597}
}

Method

We propose a semantic evolution approach for automatic collection of rich semantics, and with high-quality semantics the model achieves excellent results even with the simplest network structure.

Semantic Evolution

Overall framework

Standard Few-shot Learning Results

Dataset	1-Shot 5-Way	5-Shot 5-Way
FC100	54.27 ± 0.77	65.02 ± 0.72
CIFAR-FS	84.34 ± 0.67	89.11 ± 0.54
MiniImageNet	78.94 ± 0.66	86.49 ± 0.50
TieredImageNet	82.37 ± 0.77	89.89 ± 0.52

Cross Domain Few-shot Learning Results

Dataset	1-Shot 5-Way	5-Shot 5-Way
CUB	59.07	72.47
Places	64.01	74.70

Prerequisites

The following prerequisites are required to run the scripts:

PyTorch and torchvision
Dataset: Please download the dataset from Google Cloud and modify the corresponding dataset path in the training file.
Pre-trained weights: Please download checkpoints from Google Cloud, then put them into ./checkpoints directory.
Install packages
```
pip instal -r requirements.txt
```
Start

Please excute following commands in order.

Computing Centers

python compute_center.py
    --dataset MiniImageNet/TiredImageNet/CIFAR-FS/FC100
    --backbone resnet/swin

Training

python method/train.py 
    --max-epoch 50 
    --mode clip 
    --semantic-size 512 
    --text_type gpt 
    --shot 1  
    --step-size 40 
    --test-batch 600 
    --batch-size 128 
    --num-workers 8 
    --dataset MiniImageNet/TiredImageNet/CIFAR-FS/FC100
    --lr 1e-4 
    --backbone resnet/swin

Evaluation

python method/test.py 
    --dataset MiniImageNet/TiredImageNet/CIFAR-FS/FC100 
    --shot 1 
    --backbone resnet/swin

Acknowledgment

We thank the following repos providing helpful components/functions in our work.

zhangdoudou123 / SemFew

readme