search

tysam-code / hlb-CIFAR10

Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)
https://twitter.com/hi_tysam
Apache License 2.0
1.21k stars 75 forks source link

What is`whitening`? #6

Closed guglielmocamporese closed 1 year ago

guglielmocamporese commented 1 year ago

Hi, Thanks for this juicy work - I would like to ask you if you can explain what is and why you use the whitening procedure? Thanks, Guglielmo

guglielmocamporese commented 1 year ago

Ok got it probably it is related to this: https://myrtle.ai/learn/how-to-train-your-resnet-8-bag-of-tricks/