search

neulab / REALSumm

REALSumm: Re-evaluating Evaluation in Text Summarization
Creative Commons Attribution 4.0 International
71 stars 4 forks source link

Ignored Values #2

Closed PierreColombo closed 3 years ago

PierreColombo commented 3 years ago

Hello, Thanks a lot for your code. I am trying to reproduce fig 5a. And i see in code https://github.com/neulab/REALSumm/blob/master/analysis/analysis.ipynb that some value can be ignored ? Why is that ? Do you have the code to reproduce fig 5.A ? Best,

manikbhandari commented 3 years ago

Hi, while calculating the correlation value (pearson or kendall's tau) if the p-value is greater than 0.05 which implies that it is statistically insignificant, we ignore it. This can be seen in the code here.

PierreColombo commented 3 years ago

Ouaahh ;) Many thanks for the super fast reply ! I definitely missed this line ^^. It makes total sens :)