Closed sammlapp closed 1 month ago
lightning
branch's support for training with lightning.trainer enables mixed precision. We could still implement for plain pytorch if we want to
implemented in the lightning
branch with .use_amp property, haven't tested on GPU yet
example here: https://github.com/pscedu/bridges2-examples/blob/main/Bridges2-dist-DL-examples/Pytorch/pytorch_ddp.py