Add umT5 support to T5Model.

ThilinaRajapakse / simpletransformers

Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI

https://simpletransformers.ai/

Apache License 2.0

4.08k stars 727 forks source link

Add umT5 support to T5Model. #1550

Open robinvandernoord opened 11 months ago

robinvandernoord commented 11 months ago

I tried to use google/umT5-base with T5 but got horrible performance. Then I saw transformers had a separate umT5 class, which I added to the model classes dict in this commit.