DDAG

Pytorch Code of DDAG for Visible-Infrared Person Re-Identification in ECCV 2020. PDF

A Huawei MindSpore implementation of our DDAG method is HERE. Thanks to Zhiwei Zhang zhangzw12319@163.com.

Highlight

The goal of this work is to learn a robust and discriminative cross-modality representation for visible-infrarerd person re-identification.

Intra-modality Weighted-Part Aggregation (IWPA): It learns discriminative part-aggregated features by mining the contextual part relation.
Cross-modality Graph Structured Attention (CGSA): It enhances the feature by incorporating the neighborhood information across two modalities.

Results on the SYSU-MM01 Dataset

Method	Datasets	Rank@1	mAP	mINP
AGW [1]	#SYSU-MM01 (All-Search)	~ 47.50%	~ 47.65%	~ 35.30%
DDAG	#SYSU-MM01 (All-Search)	~ 54.75%	~ 53.02%	~39.62%
AGW [1]	#SYSU-MM01 (Indoor-Search)	~ 54.17%	~ 62.97%	~ 59.23%
DDAG	#SYSU-MM01 (Indoor-Search)	~ 61.02%	~ 67.98%	~ 62.61%

*The code has been tested in Python 3.7, PyTorch=1.0. Both of these two datasets may have some fluctuation due to random spliting

1. Prepare the datasets.

(1) RegDB Dataset [1]: The RegDB dataset can be downloaded from this website by submitting a copyright form.
- (Named: "Dongguk Body-based Person Recognition Database (DBPerson-Recog-DB1)" on their website).
- A private download link can be requested via sending me an email (mangye16@gmail.com).
(2) SYSU-MM01 Dataset [2]: The SYSU-MM01 dataset can be downloaded from this website.
- run python pre_process_sysu.py link in to pepare the dataset, the training data will be stored in ".npy" format.

2. Training.

Train a model by

python train_ddag.py --dataset sysu --lr 0.1 --graph --wpa --part 3 --gpu 0

--dataset: which dataset "sysu" or "regdb".
--lr: initial learning rate.
--graph: using graph attention.
--wpa: using weighted part attention
--part: part number
--gpu: which gpu to run.

You may need manually define the data path first.

3. Testing.

Test a model on SYSU-MM01 or RegDB dataset by

python test_ddag.py --dataset sysu --mode all --wpa --graph --gpu 1 --resume 'model_path'

--dataset: which dataset "sysu" or "regdb".
--mode: "all" or "indoor" all search or indoor search (only for sysu dataset).
--trial: testing trial (only for RegDB dataset).
--resume: the saved model path. Important
--gpu: which gpu to run.

4. Citation

Please kindly cite the references in your publications if it helps your research:

@inproceedings{eccv20ddag,
  title={Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-Identification},
  author={Ye, Mang and Shen, Jianbing and Crandall, David J. and Shao, Ling and Luo, Jiebo},
  booktitle={European Conference on Computer Vision (ECCV)},
  year={2020},
}

@article{arxiv20reidsurvey,
  title={Deep Learning for Person Re-identification: A Survey and Outlook},
  author={Ye, Mang and Shen, Jianbing and Lin, Gaojie and Xiang, Tao and Shao, Ling and Hoi, Steven C. H.},
  journal={arXiv preprint arXiv:2001.04193},
  year={2020},
}

Contact: mangye16@gmail.com

mangye16 / DDAG

readme