Do not normalize images two times

soumith / imagenet-multiGPU.torch

an imagenet example in torch.

BSD 2-Clause "Simplified" License

401 stars 158 forks source link

Do not normalize images two times #18

Closed mfigurnov closed 8 years ago

mfigurnov commented 8 years ago

Currently, images are mean/std normalized two times: in loadImage and trainHook / testHook. Looks like copy-paste bug :)

soumith commented 8 years ago

Thanks :) sorry about that

soumith commented 8 years ago

@mfigurnov interestingly, I had to change this via https://github.com/soumith/imagenet-multiGPU.torch/commit/8d59ca49d97595a66e977e5b1c936a84c595ac88

It turns out that without batch-normalization, the normalization is so sensitive, it's the difference between converging (loss goes down) and not converging....