Adding relevant paper - Githubissues

dkozlov / awesome-knowledge-distillation

Awesome Knowledge Distillation

Apache License 2.0

3.49k stars 493 forks source link

Closed HFooladi closed 5 years ago

HFooladi commented 5 years ago

Thanks for creating this repository and gathering lots of useful papers and materials. I think you can add the following paper to this list:

Improved Knowledge Distillation via Teacher Assistant: Bridging the Gap Between Student and Teacher. link to the paper

Also, there is a good implementation of this paper in PyTorch.

dkozlov commented 5 years ago

Hello @HFooladi,

Could you please make a pull request with the above papers and implementation?