How to evaluate my summary

salesforce / factCC

Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper

https://arxiv.org/abs/1910.12840

BSD 3-Clause "New" or "Revised" License

275 stars 31 forks source link

How to evaluate my summary #12

Open XuelinLuu opened 2 years ago

XuelinLuu commented 2 years ago

If I want to evaluate the summary generated by my model about cnn dailymail dataset, can I use the factcc model in the README.md directly. Should I set the label of my summary ‘CORRECT’?

yfqiu98 commented 1 year ago

Hi, is there update in this thread?

wjdghks950 commented 1 year ago

Any updates? I just faced an issue with the label in factCC/modeling/utils.py line 156, while trying to evaluate my own summary using FactCC

ValueCSV commented 3 months ago

Any updates? I just faced an issue with the label in factCC/modeling/utils.py line 156, while trying to evaluate my own summary using FactCC

Me too, did u figure it out?