search

open-mmlab / mmrazor

OpenMMLab Model Compression Toolbox and Benchmark.
https://mmrazor.readthedocs.io/en/latest/
Apache License 2.0
1.48k stars 228 forks source link

[Feature] YOLOv6 self-distillation #472

Open RangeKing opened 1 year ago

RangeKing commented 1 year ago

Describe the feature

YOLOv6 self-distillation

Motivation

Self-distillation is a common practice s to improve performance.

Related resources

https://github.com/meituan/YOLOv6

HIT-cwh commented 1 year ago

Sorry for the delayed response and thank you for your advice. Self-distillation is a widely used technique that limits the teacher to be the student itself. It's a great idea, but we haven't been able to support it yet due to manpower shortages. We'll appreciate it if you can open a pull request. And here is an example to use distillation on rtmdet.