search

layumi / Person_reID_baseline_pytorch

:bouncing_ball_person: Pytorch ReID: A tiny, friendly, strong pytorch implement of person re-id / vehicle re-id baseline. Tutorial 👉https://github.com/layumi/Person_reID_baseline_pytorch/tree/master/tutorial
https://www.zdzheng.xyz
MIT License
4.12k stars 1k forks source link

Why SGD optimizer? #174

Open Rajat-Mehta opened 4 years ago

Rajat-Mehta commented 4 years ago

Hi,

I wanted to know is there any specific reason that you are using SGD with momentum optimizer instead of more recent variants like Adam and AdaGrad?

How will the model perform if I use Adam? Would you suggest doing so?

Thanks

layumi commented 4 years ago

Hi @Rajat-Mehta , I follow the traditional ResNet training method in the original paper, which uses SGD optimizer with momentum.

You also could try Adam, and carefully set the learning rate (for example, 3e-4). It would work.