zhouzaida / channel-distillation

PyTorch implementation for Channel Distillation
100 stars 17 forks source link

About channel_distillation.py #4

Closed Youskrpig closed 4 years ago

Youskrpig commented 4 years ago

hello, Is self.connector really needed?

self.s_t_pair = [(256, 256), (512, 512), (1024, 1024), (2048, 2048)] self.connector = nn.ModuleList([conv1x1_bn(s, t) for s, t in self.s_t_pair])

i found whether to use self.connector , the output dimension of student model doesn't change.

zhouzaida commented 4 years ago

Yes, the dimension of the student have not changed, just to make the number of channel of the student the same as the teacher

Youskrpig commented 4 years ago

Thanks for your reply.