search

google-research / big_transfer

Official repository for the "Big Transfer (BiT): General Visual Representation Learning" paper.
https://arxiv.org/abs/1912.11370
Apache License 2.0
1.5k stars 175 forks source link

Experiment with SWA to improve the state of the art #38

Open LifeIsStrange opened 3 years ago

LifeIsStrange commented 3 years ago

https://pytorch.org/blog/pytorch-1.6-now-includes-stochastic-weight-averaging/ It has been shown to increase accuracy on CIFAR 100 for example