search

vacancy / Synchronized-BatchNorm-PyTorch

Synchronized Batch Normalization implementation in PyTorch.
MIT License
1.5k stars 189 forks source link

Where is "track_running_stats" implementation code? #47

Closed junha1125 closed 3 years ago

junha1125 commented 3 years ago

Hi!

I looked for "track_running_stats" implementation code. But I could not find. Since SynchBN inherit nn.modules.batchNrom, It automatically track running statics?

Thank you for your nice code.

vacancy commented 3 years ago

https://github.com/vacancy/Synchronized-BatchNorm-PyTorch/blob/master/sync_batchnorm/batchnorm.py#L68-L70

Yes. It always track the running stats.