search

chenhao2345 / ICE

Implementation for ICCV 2021 paper "ICE: Inter-instance Contrastive Encoding for Unsupervised Person Re-identification"
MIT License
44 stars 15 forks source link

About mini-batch shuffling. #6

Closed YangJae96 closed 2 years ago

YangJae96 commented 2 years ago

image image

Hi, I have some question about the implementation.

Why do you shuffle and reverse the mini-batch order before feeding it into the online encoder and momentum encoder like the above code?? image

chenhao2345 commented 2 years ago

This is a technique introduced in Kaiming's MoCo paper Page 4. This technique helps to stabilize batch normalization training on multiple GPUs.