search

ShichenLiu / CondenseNet

CondenseNet: Light weighted CNN for mobile devices
MIT License
694 stars 131 forks source link

Question on CondensingLinear #32

Closed lizhenstat closed 4 years ago

lizhenstat commented 4 years ago

Hi I notice the aim of the function(CondensingLinear) is mentioned in this answer https://github.com/ShichenLiu/CondenseNet/issues/6#issuecomment-351598403, Does CondensingLinear in layers.py only be used at convert_model phase, not in the training phase? Therefore the evaluation error on converted model will be higher than the model in the training phase, right? It is like directly pruning out 50% of the last fully connected layers without finetuning.

ShichenLiu commented 4 years ago

Yes, that is correct. However, it does not affect the test error significantly. We reported in the paper the actual eval error rate instead of training phase eval error rate.