search

jianlong-yuan / syncbn-tensorflow

Synchronized Multi-GPU Batch Normalization
67 stars 13 forks source link

Undefined role of the 'center' and 'scale' argument #1

Closed camhao168 closed 6 years ago

camhao168 commented 6 years ago

Hi, Firstly, I really appreciate your work. However, I see that the 'center' and 'scale' argument do not contribute to operation of 'beta' and 'gamma'. Can your please clarify the setting of 'center' and 'scale' in your code?

Thank you

jianlong-yuan commented 6 years ago

Sometimes, BN doesn't use gamma. So you do not need create gamma variable. But this code does not use this argument.