How to convert pytorch model to keras and train distill?

leondgarse / Keras_insightface

Insightface Keras implementation

MIT License

235 stars 56 forks source link

How to convert pytorch model to keras and train distill? #26

Closed John1231983 closed 3 years ago

John1231983 commented 3 years ago

Great repo. We found a repo uses pytorch. Could you please add a branch to use pretrained from the repo for keras distillation (similar that you are working on mxnet)? https://github.com/cavalleria/cavaface.pytorch/blob/master/docs/MODEL_ZOO.md

leondgarse commented 3 years ago

Great model zoo, seems some of my planed tests they have already done, like efficientnet / randaug. :) I'm not familiar with pytorch model. We only need the inference process to extract the embedding data. So any backend can be used as teacher model. maybe we can try ONNX...