search

OpenNMT / OpenNMT-tf

Neural machine translation and sequence learning using TensorFlow
https://opennmt.net/
MIT License
1.46k stars 392 forks source link

Remove non needed FP32 cast before softmax #975

Closed guillaumekln closed 2 years ago

guillaumekln commented 2 years ago

The softmax op already accumulates values in FP32 so there should be no numerical issues in FP16.