issues
search
Shivanandroy
/
simpleT5
simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.
MIT License
382
stars
61
forks
source link
Add support for multiple gpus in training
#53
Open
infiniterik
opened
1 year ago
infiniterik
commented
1 year ago
Loggers updated to use
sync_dist
Allow multiple gpus to be specified
Update pytorch-lightning to 2.0.1
specify ddp mode
sync_dist