search

karanchahal / distiller

A large scale study of Knowledge Distillation.
217 stars 30 forks source link

Pytorch lightning? #1

Open reactivetype opened 4 years ago

reactivetype commented 4 years ago

Very thorough and useful work!

I have not seen pytorch-lightning neither in the requirement.txt nor in the code.

Do you have a plan to refactor it to use lightning trainer and module?

reactivetype commented 4 years ago

I just saw you are working on it on a different branch. Btw do you welcome PRs?

karanchahal commented 4 years ago

Yes ! We would welcome PR's that help this repo. It could be anything, some ideas are:

  1. New Distillation techniques
  2. Clean up on code.

The lightning code is in another branch, presently there are no plans to merge it as of now.