search

open-mmlab / mmdetection

OpenMMLab Detection Toolbox and Benchmark
https://mmdetection.readthedocs.io
Apache License 2.0
29.6k stars 9.47k forks source link

confusion about fp16 #10865

Open sipie800 opened 1 year ago

sipie800 commented 1 year ago

There are some options abot fp16 training. (mmdet 3)

--amp for train.py and fp16 = dict(loss_scale='dynamic') and optim_wrapper = dict(type='AmpOptimWrapper')

What's the exactly connection between them ? Should one use them at the same time or how to configrate it?

hhaAndroid commented 1 year ago

@sipie800 fp16 = dict(loss_scale='dynamic') is invalid and should be removed. --amp and AmpOptimWrapper are equivalent.