princeton-nlp / CoFiPruning

[ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
MIT License
188 stars 32 forks source link

In the finetune stage, if the l0_module is None? #59

Open SHUSHENGQIGUI opened 2 months ago

SHUSHENGQIGUI commented 2 months ago

I follow the script in the readme for finetuning the pruned model. but running error occurs on the l0 module is None. but as the finetuing script: the hyperparam pruning_type is None, thus the l0_module is None too, right? maybe the following code has the bugs?: run_ft_mrpc.sh: image run_glue_prune.py: image

here is the bug: image if i set the prepruning_finetune_steps !=0, start_pruning is True, bug is triggled. Do I need to set prepruning_finetune_steps== 0?