Open zuoxingdong opened 4 years ago
Make online statistics as nn.Parameter and registered inside the module. It becomes trackable
nn.Parameter
Different behavior between train/eval modes.
Unit test: before replacement, benchmark with the old behavior
Make online statistics as
nn.Parameter
and registered inside the module. It becomes trackableDifferent behavior between train/eval modes.
Unit test: before replacement, benchmark with the old behavior