search

hanjanghoon / BERT_FP

Fine-grained Post-training for Improving Retrieval-based Dialogue Systems - NAACL 2021
97 stars 19 forks source link

The fin-tuned checkpoint results are not the same as the the ones in paper #1

Closed gmftbyGMFTBY closed 3 years ago

gmftbyGMFTBY commented 3 years ago

Hi, first of all, thanks for your wonderful works.

I use the fine-tuned checkpoint on douban corpus to re-implement the performance in your paper. But the results I got are lower than that in your paper: 微信截图_20210708182736

It is much lower than the results in the paper

gmftbyGMFTBY commented 3 years ago

Check the dataloader, missing the [EOS] token. BERT-FP works fine. close it.