zsyzzsoft / co-mod-gan

[ICLR 2021, Spotlight] Large Scale Image Completion via Co-Modulated Generative Adversarial Networks
Other
444 stars 67 forks source link

Implementation of Latent Normalisation #62

Closed thorinf-orca closed 10 months ago

thorinf-orca commented 10 months ago

https://github.com/zsyzzsoft/co-mod-gan/blob/c8b9ffe30c950dfdfb9e86652a27b6e72304b3d5/training/co_mod_gan.py#L285C1-L286C1

In this line the normalisation is done by applying the reduce_mean. Usually I would expect to see the sum, which would be L2 normalisation and would keep the vector at unit variance.

There is a normalisation strategy mentioned in the paper, however it does not match what has been implemented.

image

Would it be possible to get some clarification?

Thanks