Shivanandroy / simpleT5

simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.
MIT License
382 stars 61 forks source link

Add LongT5 support #36

Open Shivanandroy opened 2 years ago

Shivanandroy commented 2 years ago

@somakaushik98 : Please update the requirements.txt file, as LongT5 is implemented in the latest version of transformers

kamranjon commented 1 year ago

@Shivanandroy can we merge this now?