search

cesarali / fimodemix

Foundation Models for ODE
0 stars 0 forks source link

Create Dummy Distillation #4

Open cesarali opened 3 weeks ago

cesarali commented 3 weeks ago

The goal is to be able to simply load the parameters of a bigger model FIMODEClassify into FIMODEClassifyLight

Thats is you should inherit this class jointly with FIMODEClassifyLight and set the parameters of the student (FIMODEClassifyLight) from the teacher (FIMODEClassify)

https://github.com/cesarali/fimodemix/blob/f4670ca4ccc6e595d224fc2edccff76f49c6f82a/src/fimodemix/models/fim_distillation.py#L5