Fix seq2seq distillation - Githubissues

JulesBelveze / bert-squeeze

🛠️ Tools for Transformers compression using PyTorch Lightning ⚡

https://julesbelveze.github.io/bert-squeeze/

78 stars 10 forks source link

Fix seq2seq distillation #68

Closed tarekziade closed 4 months ago

tarekziade commented 4 months ago

added missing optimization param
added the get_student_logits and get_teacher_logits methods
added loss_ce