QingruZhang / PLATON

This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
41 stars 5 forks source link

What is the model to be pruned? #4

Closed Nofear18 closed 5 months ago

Nofear18 commented 10 months ago

May I ask if you are performing the pruning at the task-specific fine-tuning model or if all tasks are performing the pruning at the pre-trained bert-base model?