How to update mean and variance?

WeitaoVan / L-GM-loss

Implementation of our accepted CVPR 2018 paper "Rethinking Feature Distribution for Loss Functions in Image Classification"

MIT License

172 stars 34 forks source link

How to update mean and variance? #7

Closed zhuyiche closed 5 years ago

zhuyiche commented 6 years ago

Hi, I'm currently using lgm loss in my research project, i'm wondering how to update mean and variance under the setting?

WeitaoVan commented 6 years ago

Hi, they are updated by standard gradient descent, with a proper initial value and a relatively low learning rate compared to the overall learning rate.