search

VainF / Torch-Pruning

[CVPR 2023] DepGraph: Towards Any Structural Pruning
https://arxiv.org/abs/2301.12900
MIT License
2.73k stars 335 forks source link

About LAMP #278

Open Kk875 opened 1 year ago

Kk875 commented 1 year ago

Hello, I have a question. I saw that the LAMP algorithm was implemented in the code of the paper, but the description in the original paper said that LAMP is an unstructured pruning algorithm, but why is it structured in your library? Appears in the form of pruning, sincerely hope to get your answer

VainF commented 1 year ago

Hi @Kk875, LAMP is a normalization method actually. It normalizes importance scores from different layers into a comparable scale. So, it's easy and natural to adapt LAMP to structured pruning.