Seeking clarification on certain aspects of the article.

[JACK-Chen-2019]

Hello, I've gained a lot from reading your article, but there are some points that I don't quite understand.

1. How to obtain the result of Formula 4
2. Why update mean and var with Formula 5 Looking forward to your response. Thanks!

[TaesikGong]

Hi, First of all, thank you for your interest in our work.

1.

I assume that you are aware of the term "sampling distribution" (https://en.wikipedia.org/wiki/Sampling_distribution) For the variance of the sample mean, please refer to "Standard error" section of this doc (https://en.wikipedia.org/wiki/Sampling_distribution). You can obtain the same formula by squaring the written equation.

For the variance of the sample variance, please refer to "Distribution of the sample variance" section of this doc (https://en.wikipedia.org/wiki/Variance) You can see the same formula.

2.

Our idea is to correct normalization statistics only when the deviation between IN statistics and BN statistics is significant. The soft-shrinkage function (https://pytorch.org/docs/stable/generated/torch.nn.Softshrink.html) is suitable for this purpose.

I hope this helps, and please feel free to let us know if you have any more questions.