search

open-mmlab / mmpretrain

OpenMMLab Pre-training Toolbox and Benchmark
https://mmpretrain.readthedocs.io/en/latest/
Apache License 2.0
3.29k stars 1.03k forks source link

MMPretrain doesn't support training in distillation mode. #1594

Open Satyajit1993 opened 1 year ago

Satyajit1993 commented 1 year ago

Branch

main branch (mmpretrain version)

Describe the bug

while trying to run LeViT got this error.

NotImplementedError: MMPretrain doesn't support training in distillation mode.

Environment

python 3.10. pytorch 1.13.1+cu117

Other information

No response

Ezra-Yu commented 1 year ago

Sorry that we have not supported it. Maybe you can use MMRazor.deit, just modify the backbone.