search

akamaster / pytorch_resnet_cifar10

Proper implementation of ResNet-s for CIFAR10/100 in pytorch that matches description of the original paper.
BSD 2-Clause "Simplified" License
1.22k stars 335 forks source link

Learning rate for ResNet 110 #21

Closed jakesokol1 closed 4 years ago

jakesokol1 commented 4 years ago

I am trying to train resnet110. After the first epoch, the learning rate does not return to .1, and it stays at .01. I believe this is not intended.

jakesokol1 commented 4 years ago

I believe this yields expected behavior (if it is actually desired that only the first epoch have learning rate of .01).

for epoch in range(args.start_epoch, args.epochs):
    if epoch == 1:
        for param_group in optimizer.param_groups:
            param_group['lr'] *= 10

`