What if the case that gamma is near zero, but beta is very large?

Eric-mingjie / network-slimming

Network Slimming (Pytorch) (ICCV 2017)

MIT License

907 stars 214 forks source link

Open yzlyty opened 4 years ago

yzlyty commented 4 years ago

There is only consideration of l1 regularization of gamma, but how about beta? If gamma is near zero but beta is large, should we prune that channel?

Eric-mingjie commented 4 years ago

Maybe. The method considers only gamma for pruning.