mit-han-lab / lite-transformer

[ICLR 2020] Lite Transformer with Long-Short Range Attention
https://arxiv.org/abs/2004.11886
Other
596 stars 81 forks source link

Could you share Quantify and Pruning script? Thank you very much! #11

Closed fansiawang closed 4 years ago

kalyangvs commented 4 years ago

Just in case you have not seen this issue - https://github.com/mit-han-lab/lite-transformer/issues/4 Distiller link and the configuration used are available there.

Michaelvll commented 4 years ago

Thank you for the question! As @gvskalyan mentioned, you can find the script in issue #4. :)