fp16 training using pytorch amp

uf-hobi-informatics-lab / ClinicalTransformerNER

a library for named entity recognition developed by UF HOBI NLP lab featuring SOTA algorithms

MIT License

142 stars 28 forks source link

fp16 training using pytorch amp #4

Closed bugface closed 3 years ago

bugface commented 4 years ago

since PyTorch 1.6.0, a PyTorch amp package is available now for fp.16 training. We will update the code to use the PyTorch amp instead of Apex when it is possible.

bugface commented 3 years ago

resolved. We only support naive fp16 implementation based on PyTorch 1.6. We do not support Apex anymore.