brain-research / realistic-ssl-evaluation

Open source release of the evaluation benchmark suite described in "Realistic Evaluation of Deep Semi-Supervised Learning Algorithms"
Apache License 2.0
460 stars 98 forks source link

Fix ZCA normalization on ImageNet32 #3

Closed avital closed 6 years ago

avital commented 6 years ago

Before this change, ZCA normalization on ImageNet was run on flattened arrays from NHWC -- even though the ZCA statistics for CIFAR10 were computed from flattened arrays from NCHW.

Hopefully, after this change we may get better fine-tuning results on the ImageNet->CIFAR10 experiment.

avital commented 6 years ago

(Turns out this did not affect the results of the fine-tuning experiment as some of us had expected)