captain-pool / GSOC

Repository for Google Summer of Code 2019 https://summerofcode.withgoogle.com/projects/#4662790671826944
MIT License
68 stars 22 forks source link

Adding Trainer #52

Closed captain-pool closed 5 years ago

captain-pool commented 5 years ago

Adding Trainer for Knowledge Distillation.

Addresses #42, #45 , #46 , #47, #44

captain-pool commented 5 years ago

Have we added any README or documentation that references the paper we are using for this? And what changes we are making to the loss function, etc?

We have 2 options for Loss. We can choose any of these, depending on the output we are getting.

I've implemented both, we will be using each of them based on the output we get.