search

bigscience-workshop / evaluation

Code and Data for Evaluation WG
Other
41 stars 24 forks source link

Add XSum to Full Benchmark #41

Closed aobaruwa closed 3 years ago

wilsonyhlee commented 3 years ago

I think the goal is to only add datasets that are on this list, and it doesn't look like XSum is on it. Can you confirm, @epavlick?

aobaruwa commented 3 years ago

Right, CRD3 is the selected dataset for text summarization. So, I'm closing the issue

epavlick commented 3 years ago

Actually this is part of GEM--we expanded out GEM and created one issue per GEM task that we want to include (since we weren't including all tasks). Reopening.

wilsonyhlee commented 3 years ago

I think this other issue was meant for XSum as a part of GEM? This issue would be a duplicate?

epavlick commented 3 years ago

Ahh I see, yes good catch! Closing the issue again then. :)