The authors propose a model named T5 for classification/translation/question answering/summarization and large scale English dataset C4. And comprehensively investigates pre-training strategies; the format of the mask, etc. It got SOTA for various tasks.
TL;DR
The authors propose a model named T5 for classification/translation/question answering/summarization and large scale English dataset C4. And comprehensively investigates pre-training strategies; the format of the mask, etc. It got SOTA for various tasks.![image](https://user-images.githubusercontent.com/24524018/92561840-e5fd4200-f2af-11ea-9c2c-2fae7f783207.png)
Why it matters:
Paper URL
https://arxiv.org/abs/1910.10683
Submission Dates(yyyy/mm/dd)
Authors and institutions
Methods
Results
Comments