search

TreB1eN / InsightFace_Pytorch

Pytorch0.4.1 codes for InsightFace
MIT License
1.73k stars 423 forks source link

Learning rate #2

Closed tensorboy closed 5 years ago

tensorboy commented 6 years ago

Using the default learning rate 0.001 will not work on my side.

Just let you know that I tried 0.01 and that number worked very well. :)

TreB1eN commented 6 years ago

Did you use the default batchsize?

tensorboy commented 6 years ago

Yeah, it is 100, right?

TreB1eN commented 6 years ago

maybe I shoud change that default lr, on my 1080Ti, ir_se50 model uses batchsize 100, mobilefacenet uses 200, and you can first find the best batchsize, then use find_lr to locate best lr in your machine, this technique was introduceD by fastai

tensorboy commented 6 years ago

Great, thanks for your information. I changed it to 200 and retraining now.

TreB1eN commented 5 years ago

closing