search

akamaster / pytorch_resnet_cifar10

Proper implementation of ResNet-s for CIFAR10/100 in pytorch that matches description of the original paper.
BSD 2-Clause "Simplified" License
1.22k stars 335 forks source link

Learning rate and optimizer #8

Closed yunfei-teng closed 5 years ago

yunfei-teng commented 5 years ago

Could you provide the optimizer you were using for the training including learning rates and momentum, please? My test error only reaches 20% on resnet20.

akamaster commented 5 years ago

the repo is self contained, take a look at https://github.com/akamaster/pytorch_resnet_cifar10/blob/master/run.sh and https://github.com/akamaster/pytorch_resnet_cifar10/blob/master/trainer.py

p3i0t commented 5 years ago

Simply using optimizer Adam with learning rate lr=0.001(other hyperparameters unchanged), I get <5% error rate on CIFAR10 test set on resnet20 after training ~60 epochs.