We need correct checkpoints

akamaster / pytorch_resnet_cifar10

Proper implementation of ResNet-s for CIFAR10/100 in pytorch that matches description of the original paper.

BSD 2-Clause "Simplified" License

1.22k stars 335 forks source link

We need correct checkpoints #4

Closed Oktai15 closed 6 years ago

Oktai15 commented 6 years ago

Hi, @akamaster! Great work!

Actually, for comparing of results we need to train ResNet's on 45k (train), choose best on 5k (validation) and write as result accuracy on 10k (test). Your better results mean that you slightly "overfitting" on test, because you chose best model by test and it is not correctly at all. So, if it is possible then re-train models on 45k/5k.

akamaster commented 6 years ago

Thanks for suggestion, I know about it and I don't have time to re-train or do something new with this repository yet. You are welcome to retrain the models using validation split and make a pull request, I would happily update current models or add your models to accompany them. Hope that helps, Yerlan