what is the distillation model and where should i go to download it ?

princeton-nlp / CoFiPruning

[ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408

MIT License

192 stars 31 forks source link

what is the distillation model and where should i go to download it ? #58

Open SHUSHENGQIGUI opened 5 months ago

SHUSHENGQIGUI commented 5 months ago

Hello, could you please explain what a distillation model is, and what is the distillation_path mentioned in the sample run.sh script? Where should I go to download it?

Thank you!!