Closed balasurajp closed 4 years ago
Is there any specific reason behind using SGD with weight decay, but not Adam Optimizer?
Hi, sorry for my late reply. I have tried Adam in the past, however, it doesn't obtain obvious gains. So I keep using the simple SGD.
Is there any specific reason behind using SGD with weight decay, but not Adam Optimizer?