Thank you for doing such an excellent work and open source. After I tried to use your distillation, the network did not learn when I was fine-tuning. Have you encountered related problems?

[OliverRensu]

What tasks do you use the distillation on? Can you provide more details?