hunto / image_classification_sota

Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
Apache License 2.0
81 stars 14 forks source link

add knowledge distillation methods #4

Closed hunto closed 2 years ago

hunto commented 2 years ago

Support the following response-based KD methods: