Where can i see the detail of distillation?

princeton-nlp / CoFiPruning

[ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408

MIT License

189 stars 31 forks source link

Where can i see the detail of distillation? #32

Closed zoetu closed 2 years ago

zoetu commented 2 years ago

Thank you for your work! In the process of implementation, I have a little question, where can i find the details of the distillation part of the code? Hope you can reply me, it will be very helpful to me.