search

JulesBelveze / bert-squeeze

🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
https://julesbelveze.github.io/bert-squeeze/
78 stars 10 forks source link

feat: introduce `DistilAssistant` #41

Closed JulesBelveze closed 1 year ago

JulesBelveze commented 1 year ago

This PR aims at introducing a new helper object: DistilAssistant.

Its role is to centralize and instantiate the different components needed to perform distillation.