search

jinlanfu / GPTScore

Source Code of Paper "GPTScore: Evaluate as You Desire"
219 stars 16 forks source link

Request examples for evaluating text summarization #6

Open chris-opendata opened 1 year ago

chris-opendata commented 1 year ago

Great work. I intend to utilize it for my abstractive text summarization paper. Would you be able to upload the related examples? I am interested in evaluating semantic coverage, factuality, informativeness, and fluency following the aspect definitions in your paper.

Kind regards

jinlanfu commented 1 year ago

Thanks for your interest in our work and your question. Due to the maximum length limitation of the model deployed by GPTScore, in-context learning is challenging to apply in the text summarization task. We did not construct demonstration samples for the summarization task as we did for other tasks.