Is Next Sentence Prediction implemented in the code ?

zihangdai / xlnet

XLNet: Generalized Autoregressive Pretraining for Language Understanding

Apache License 2.0

6.16k stars 1.18k forks source link

Is Next Sentence Prediction implemented in the code ? #262

Open GhaliaRehawi opened 4 years ago

GhaliaRehawi commented 4 years ago

Hi, You mention in the paper that you have excluded the next-sentence prediction objective from XLNet since it didn't introduce any improvements, However in the Ablation study you also report the performance in case of using NSP. My question is : is NSP implemnted here in your github repo or not?

Thanks a lot