search

intersun / CoDIR

Code for EMNLP 2020 paper CoDIR
MIT License
41 stars 8 forks source link

Memory.py #1

Closed Alva-2020 closed 4 years ago

Alva-2020 commented 4 years ago

Thanks for sharing. I am confused that buffer initialized by random. Why the random weight can be seemed as the anchor?

intersun commented 4 years ago

Good catch, the memory bank is randomly initialized, but eventually will converge after some updates (SGD like).

Intuitively, you can think the weights of NN are randomly initialized, but will converge to some point after some SGD updates.