Distilling the Knowledge in a Neural Network

[joyhuang9473]

Distilling the Knowledge in a Neural Network

• Author: Geoffrey Hinton, Oriol Vinyals, Jeff Dean
• Origin: https://arxiv.org/abs/1503.02531
• Related:
  • https://github.com/wentianli/knowledge_distillation_caffe
  • 论文笔记 《Distilling the Knowledge in a Neural Network》

teacher network, student network

soft targets

Temperature

[joyhuang9473]

10