facebookresearch / AttentiveNAS

code for "AttentiveNAS Improving Neural Architecture Search via Attentive Sampling"
Other
103 stars 21 forks source link

usage of function zero_residual_block_bn_weights #9

Closed wmkai closed 2 years ago

wmkai commented 2 years ago

Hi! Thanks for your great job! I want to know why the function zero_residual_block_bn_weights should be used? what will be happen if it is not used?

dilinwang820 commented 2 years ago

We followed this setting suggested in the BigNAS paper - https://arxiv.org/pdf/2003.11142.pdf (first paragraph, page 6.)

wmkai commented 2 years ago

Thanks for your reply, it helps me a lot!