Lightning-Universe / lightning-transformers

Flexible components pairing 🤗 Transformers with :zap: Pytorch Lightning
https://lightning-transformers.readthedocs.io
Apache License 2.0
610 stars 77 forks source link

Reflect default settings changed to using ddp #175

Closed taeminlee closed 3 years ago

taeminlee commented 3 years ago

Thank you for the very good repository.

The default configuration has been updated recently. Because there is no ddp anymore, an error is occurring when deepspeed and sharded are selected among the trainers.

we proceeded with a simple correction.