huggingface / nn_pruning

Prune a model while finetuning or training.
Apache License 2.0
394 stars 58 forks source link

Is it possible to prune only particular (not all parameters) of the transformer ? #43

Open mayank64ce opened 2 months ago

mayank64ce commented 2 months ago

Say the transformer has parameters A, B, C etc. is it possible to prune only parameter B ?