search

facebookresearch / moco

PyTorch implementation of MoCo: https://arxiv.org/abs/1911.05722
MIT License
4.83k stars 794 forks source link

Difference between the encoder_q and the encoder_k. #63

Open RuoyiDu opened 4 years ago

RuoyiDu commented 4 years ago

Dear author: The momentum update strategy ensures the consistency of query encoder at each step, but it leads to the difference between the query encoder and the key encoder. Why the consistence of encoder_q at each step is more important than the consistence between encoder_q and encoder_k?

houhouhouhou11 commented 3 years ago

@RuoyiDu hello, i have this question too. Have you understood why the consistence of encoder_q at each step is more important than the consistence between encoder_q and encoder_k? Thank you very much.