yhcc / BARTABSA

142 stars 28 forks source link

About reproduction #7

Closed Life-0-1 closed 2 years ago

Life-0-1 commented 2 years ago

Hi, I am reproducing you work, but I found that after running with the default settings on the pengb/14lab, I got the triplet metrics as follows: triple_f=57.73, triple_rec=56.81, triple_pre=58.68, while in the paper, the results should be: triple_f=58.69, triple_rec=56.19, triple_pre=61.41. Is there any suggestion?

Life-0-1 commented 2 years ago

Hi, I am reproducing you work, but I found that after running with the default settings on the pengb/14lab, I got the triplet metrics as follows: triple_f=57.73, triple_rec=56.81, triple_pre=58.68, while in the paper, the results should be: triple_f=58.69, triple_rec=56.19, triple_pre=61.41. Is there any suggestion?

Sorry, my results mentioned above is on the dev dataset, and the test set results are even better than the paper reports. I am closing this issue.