Eric-mingjie / rethinking-network-pruning

Rethinking the Value of Network Pruning (Pytorch) (ICLR 2019)
MIT License
1.51k stars 293 forks source link

Question about skip #15

Open JinShchen opened 5 years ago

JinShchen commented 5 years ago

I want to ask the skip in pruning.py. Why choose these layer to prune? Cause I want to prune my own resnet101 and I wonder if there are any rules about how to choose layers to prune. Thanks~

Eric-mingjie commented 5 years ago

Could you point to which prune methods you are using? Or which files you are referring to?

JinShchen commented 5 years ago

Could you point to which prune methods you are using? Or which files you are referring to?

imagenet/l1-norm-pruning/prune.py
line 131

Eric-mingjie commented 5 years ago

We are following strictly the pruning rules in the original L1 norm pruning paper. In short, they choose which layers to prune based on their sensitivity.