ggjy / DeFeat.pytorch

111 stars 10 forks source link

About student pretrain #7

Closed yarkable closed 3 years ago

yarkable commented 3 years ago

Thanks for your nice work, and, I wonder that when distilling, is student initialized with a pretrained model(e.g. after training for 12 epochs) or just with a pretrained backbone?

ggjy commented 3 years ago

Just with an ImageNet pretrained backbone (provided by MMDet).

yarkable commented 3 years ago

Got it, thanks.