irfanICMLL / structure_knowledge_distillation

The official code for the paper 'Structured Knowledge Distillation for Semantic Segmentation'. (CVPR 2019 ORAL) and extension to other tasks.
BSD 2-Clause "Simplified" License
695 stars 104 forks source link

Teacher Model #15

Closed Vincent-Hoo closed 4 years ago

Vincent-Hoo commented 4 years ago

Can you provide the teacher model trained on cityscapes?

irfanICMLL commented 4 years ago

Please refer to this issue https://github.com/irfanICMLL/structure_knowledge_distillation/issues/4

Vincent-Hoo commented 4 years ago

Thank you very much!! I have another question about loading pretrained resnet to PSPNet. The lower part of PSPNet is slightly different from that of ResNet. PSPnet has three layers of {conv, relu, bn} while ResNet only has one layer. Did you re-train the new-ResNet (with 3 {conv, relu, bn} layers) in ImageNet dataset. I've checked the "load_S_model" function, and in the "conv1.weight" module, there's a dimension dismatch.

irfanICMLL commented 4 years ago

For the teacher net I follow this link, and use the pretrained weight it provides.

https://github.com/CSAILVision/semantic-segmentation-pytorch/blob/master/models/resnet.py