search

Shivanandroy / simpleT5

simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.
MIT License
387 stars 62 forks source link

TPU support #27

Open peregilk opened 2 years ago

peregilk commented 2 years ago

Any chance you can add TPU support in the Colab? I think this is supported more of less out of the box now in the newest pyTorch Lightning versions.

swcrazyfan commented 2 years ago

This is what I was about to ask! Would be amazing.

swcrazyfan commented 2 years ago

I'm working through the PyTorch Lightning docs, and I think I almost have working TPU support soon! I'll submit a pull request at that time.

peregilk commented 2 years ago

@swcrazyfan @Shivanandroy Any status on this?

sr5434 commented 1 year ago

Yeah @Shivanandroy will you add this feature?