How can i train my t5 (not t5.1 or not mt5) model from scratch?

Shivanandroy / simpleT5

simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.

MIT License

382 stars 61 forks source link

Open 520jefferson opened 2 years ago

520jefferson commented 2 years ago

I want to train my t5 model from scratch and with bpe tokenizer, is there a example ?