huggingface / nn_pruning

Prune a model while finetuning or training.
Apache License 2.0
394 stars 58 forks source link

Is global sort supported? #26

Open xiaowu0162 opened 3 years ago

xiaowu0162 commented 3 years ago

In the older version of this repository, there is an option global_topk in the masked run examples (https://github.com/huggingface/block_movement_pruning/blob/c16cecafb9db2636250487064e00896a77772a3a/block_movement_pruning/masked_run_glue.py). I think this allows globally sorting the pruning units. Is this functionality supported by nn_pruning?