search

Liyan06 / AggreFact

Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)
22 stars 1 forks source link

Summarizer `missing` #12

Closed forrestbao closed 8 months ago

forrestbao commented 8 months ago

Hi, in your data, under the model_name column, some values are missing. Are samples of such a value in the model_name column counted into OLD, ExFormer, SOTA, or not used in your analysis at all"?

Liyan06 commented 8 months ago

Hi, @forrestbao those should be counted into OLD. "missing" here means that the model names were not specified in original dataset construction. However, given the year those datasets were created, those "missing" models should be counted into OLD.