Any plan for Turkish T5?

stefan-it / turkish-bert

Turkish BERT/DistilBERT, ELECTRA and ConvBERT models

482 stars 42 forks source link

Any plan for Turkish T5? #17

Closed monatis closed 3 years ago

monatis commented 3 years ago

Hi @stefan-it, thanks a lot again for the great job you're doing here. Now that I'm planning to train a Turkish T5 from scratch, I just want to ask if you have any such plan to not duplicate the resources to be spent.

stefan-it commented 3 years ago

Hi @monatis , I haven't any plans for training a T5 model 😅

But I can tell you, that I've trained a Funnel Transformer and I'm waiting for the integration into Transformers for checkpoint evaluation 🤗

monatis commented 3 years ago

Thanks for the quick response @stefan-it. Funnel Transformer is just amazing and looking forward to it 🤗 I'll also look into T5 at the same time 🏃‍♂️