search

nlpyang / BertSum

Code for paper Fine-tune BERT for Extractive Summarization
Apache License 2.0
1.47k stars 424 forks source link

ROUGE1.5.5 #24

Closed FTUfred closed 5 years ago

FTUfred commented 5 years ago

hi, Can i have your ROUGE1.5.5 file or download link? Beacause my lead3 and other result is better than the result on your paper . Is it normal ?

Thanks.

nlpyang commented 5 years ago

My rouge program should be no different from yours. The preprocessing codes have been modified, so if your result is not marginally different, it should be normal.

FTUfred commented 5 years ago

Sorry. I use pyrouge0.1.3 and this ROUGE1.5.5 But my lead3 score different from result on paper. image

nlpyang commented 5 years ago

Rouge depends on tokenization, preprocessing and other factors. The difference between our scores is minor and acceptable.