researchmm / SiamDW

[CVPR'19 Oral] Deeper and Wider Siamese Networks for Real-Time Visual Tracking
http://openaccess.thecvf.com/content_CVPR_2019/html/Zhang_Deeper_and_Wider_Siamese_Networks_for_Real-Time_Visual_Tracking_CVPR_2019_paper.html
MIT License
751 stars 180 forks source link

Rationale behind Optimizer #72

Closed balasurajp closed 4 years ago

balasurajp commented 4 years ago

Is there any specific reason behind using SGD with weight decay, but not Adam Optimizer?

JudasDie commented 4 years ago

Is there any specific reason behind using SGD with weight decay, but not Adam Optimizer?

Hi, sorry for my late reply. I have tried Adam in the past, however, it doesn't obtain obvious gains. So I keep using the simple SGD.