The authors propose a model named T5 for classification/translation/question answering/summarization and large scale English dataset C4. And comprehensively investigates pre-training strategies; the format of the mask, etc. It got SOTA for various tasks.
TL;DR
The authors propose a model named T5 for classification/translation/question answering/summarization and large scale English dataset C4. And comprehensively investigates pre-training strategies; the format of the mask, etc. It got SOTA for various tasks.
Why it matters:
Paper URL
https://arxiv.org/abs/1910.10683
Submission Dates(yyyy/mm/dd)
Authors and institutions
Methods
Results
Comments