Declare `amp_backend` parameter for Torch Lightning

minimaxir / aitextgen

A robust Python tool for text-based AI training and generation using GPT-2.

https://docs.aitextgen.io

MIT License

1.84k stars 220 forks source link

Closed cuuupid closed 2 years ago

cuuupid commented 2 years ago

Addressing #180

lightning requires explicitly setting the AMP backend
the AMP level is only set when utilizing fp16 floats, so this sets the amp backend under the same conditions