search

HobbitLong / RepDistiller

[ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
BSD 2-Clause "Simplified" License
2.11k stars 389 forks source link

the introduction of ContrastMemory #27

Open sanshanxiashi opened 3 years ago

sanshanxiashi commented 3 years ago

Thanks for your excellent work! I wonder how can I learn about the implementation of memory bank in the paper. Is it the same as the implementation of memory bank in Kaiming's MoCo? I can't see the introduction in your paper.

HobbitLong commented 3 years ago

No, this paper was earlier than Kaiming's MoCo paper, the implementation of Memory bank in the paper follows InstDis and CMC.

But I think you can replace the current one with the MoCo style memory.