yangxue0827 / RotationDetection

This is a tensorflow-based rotation detection benchmark, also called AlphaRotate.
https://rotationdetection.readthedocs.io/
Apache License 2.0
1.08k stars 182 forks source link

大佬,咨询下在cls方法下训练出现loss变为nan的情况,如何解决 #17

Closed jjRen-xd closed 3 years ago

jjRen-xd commented 3 years ago

Screenshot from 2021-05-18 15-17-56 如图,使用cls方法在DOTA1.0下训练时loss不收敛,最终报错停止,这是我数据集处理错了吗,或者单卡的学习率需要如何调整,不是太清楚,求助

yangxue0827 commented 3 years ago

调低学习率试试,然后打开tensorboard看gt就能确定你的数据有没有处理错。

jjRen-xd commented 3 years ago

多谢多谢,单卡怎么试都不行,换了多卡就解决了