[demo] Use ms.nn.Normalization instead of torch.nn.BatchNorm1d

meta-soul / MetaSpore

A unified end-to-end machine intelligence platform

Apache License 2.0

642 stars 118 forks source link

[demo] Use ms.nn.Normalization instead of torch.nn.BatchNorm1d #92

Closed andafterall closed 2 years ago

andafterall commented 2 years ago

Use ms.nn.Normalization instead of torch.nn.BatchNorm1d: In parameter server architecture, we should use ms.nn.Normalization which handled global exponentially weighted moving average already.