search

intersun / CoDIR

Code for EMNLP 2020 paper CoDIR
MIT License
41 stars 8 forks source link

Pretraining codes #4

Open YeDeming opened 3 years ago

YeDeming commented 3 years ago

Hi Siqi,

Thanks for releasing the great code.

I cannot find the pretraining code in this repository about the implement of the in-batch negative examples? Could you point out it?

And it seems there is no 'masked_lm_distill_crd' in the criterions?

Thanks!

Best, Deming

jinxinglu commented 2 years ago

HI, Deming, did you find the implement of the negative examples in the pre-training?

thanks