Hi i have already sparsity the gamma of layerNorm in Segformer. Can I use the methode to prune the model ?

VainF / Torch-Pruning

[CVPR 2023] Towards Any Structural Pruning; LLMs / SAM / Diffusion / Transformers / YOLOv8 / CNNs

https://arxiv.org/abs/2301.12900

MIT License

2.44k stars 308 forks source link

Open kevin-dll opened 2 months ago