search

Lightning-Universe / lightning-transformers

Flexible components pairing 🤗 Transformers with :zap: Pytorch Lightning
https://lightning-transformers.readthedocs.io
Apache License 2.0
610 stars 77 forks source link

Mixed precision: scheduler called in the wrong order #201

Closed aleSuglia closed 2 years ago

aleSuglia commented 3 years ago

This bug is a result of the following PL issue: https://github.com/PyTorchLightning/pytorch-lightning/issues/5558

carmocca commented 2 years ago

Closing as there's nothing actionable from the transformers side, you can keep track of that issue for progress.