Fix and update distillation

alibaba / FederatedScope

An easy-to-use federated learning platform

https://www.federatedscope.io

Apache License 2.0

1.3k stars 210 forks source link

Fix and update distillation #675

Closed rayrayraykk closed 1 year ago

rayrayraykk commented 1 year ago

The teacher is a complete emulator. The correct implementation is that the student is a compressed emulator, and the incorrect implementation is that student was compressed emulator+adapter.