search

arxyzan / data2vec-pytorch

PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI
MIT License
172 stars 26 forks source link

question about disabling gradient bp #8

Closed XiaoyuShi97 closed 2 years ago

XiaoyuShi97 commented 2 years ago

https://github.com/facebookresearch/fairseq/blob/main/fairseq/modules/ema_module.py#L41 Hi. It seems you forget this line, which may also disable gradient bp of the student encoder? Thx!

arxyzan commented 2 years ago

Hello Xiaoyu, thanks for your suggestion. I fixed the issue!