About the SVTR model using fp16

open-mmlab / mmocr

OpenMMLab Text Detection, Recognition and Understanding Toolbox

https://mmocr.readthedocs.io/en/dev-1.x/

Apache License 2.0

4.18k stars 735 forks source link

About the SVTR model using fp16 #2053

Open AshleyD707 opened 4 weeks ago

AshleyD707 commented 4 weeks ago

What is the feature?

After adopting half-precision computations for the model, the predictions exhibited substantial discrepancies when compared to those derived from single-precision (fp32) calculations.

Any other context?

No response

AshleyD707 commented 4 weeks ago

And is the model compatible with AMP training? I tried it train with about 1W data. However, the loss fails to decrease, and the model's predictions consistently yield None outputs.