search

Liyan06 / AggreFact

Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)
22 stars 1 forks source link

What is PegasusDynamic in your data? #11

Closed forrestbao closed 8 months ago

forrestbao commented 8 months ago

Hi, I am looking at the data you provided. There is one summarizer model called PegasusDynamic. What is it? It is a variation of Pegasus?

Liyan06 commented 8 months ago

We use this name directly from "SummEval: Re-evaluating Summarization Evaluation"

forrestbao commented 8 months ago

Thanks for your response. Are there overlaps between Pegasus and PegasusDynamic in your dataset? I do not wanna use the same sample twice when evaluating.

Liyan06 commented 8 months ago

We have ensured that there is no duplicated data in the benchmark.