why there is a “bn_tracking” attribute in Dynamic_BN?

facebookresearch / AttentiveNAS

code for "AttentiveNAS Improving Neural Architecture Search via Attentive Sampling"

Other

103 stars 21 forks source link

why there is a “bn_tracking” attribute in Dynamic_BN? #2

Closed YYangZiXin closed 3 years ago

YYangZiXin commented 3 years ago

I didn't find its usage.

dilinwang820 commented 3 years ago

You're right; bn_tracking is not used in the code. During evaluation, all BN statistics will be re-calibrated using a small amount of training data following Slimmable networks. "bn_tracking" could be removed from Dynamic_BN without affect the current flow.