google-research-datasets / xsum_hallucination_annotations

Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (https://www.aclweb.org/anthology/2020.acl-main.173.pdf).
80 stars 6 forks source link

Requesting 'pilot studies' you provided to your annotators #9

Open shailaja183 opened 1 year ago

shailaja183 commented 1 year ago

You have mentioned in that paper that-- "Your annotators went through two pilot studies to have a better understanding of intrinsic and extrinsic hallucinations, and factuality of summaries". I am interested in conducting a similar study and it would be helpful if you can share pilot study/detailed instruction document.