Liyan06 / AggreFact

Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)
22 stars 1 forks source link

Sentence level dataset #8

Closed ariecattan closed 1 year ago

ariecattan commented 1 year ago

Thanks for the great work, your benchmark is more than useful!

Could you please provide the dataset at the sentence level? This is particularly helpful in CNN/DM summaries where some sentences might be faithful and others not.

Liyan06 commented 1 year ago

Thanks for the question! We do not provide the dataset at the sentence level as for some datasets the human annotated label is on the summary level. We cannot easily obtain sentence-level annotation label based on summary-level labels.

ariecattan commented 1 year ago

Got it, thanks!