liyunsheng13 / BDL

MIT License
222 stars 30 forks source link

how did you make initial weight? #13

Closed MyeongJin-Kim closed 5 years ago

MyeongJin-Kim commented 5 years ago

Before training FCN8s-VGG16 model, I test initial weight you provide. Then I got 30.0 mIoU. In paper, you wrote imagenet pretrained model. But in my thought, initial model's high mIoU means it is trained on supervision of segmentation data. How did you make the initial weight??

liyunsheng13 commented 5 years ago

Just train the model with the synthetic data for initialization.

MyeongJin-Kim commented 5 years ago

Thanks for fast answer! When I train model with imagenet pretrained weight, Deeplab-ResNet101 model switch from classification feature to segmentation feature very fast. But for FCN8s-VGG16, it shows extremely show transform. Did you get the same pattern??

liyunsheng13 commented 5 years ago

I'm sorry I cannot remember. I think different initialization should not cause any difference to the final adaptation results. But like you said, the adaptation speed might be different.

MyeongJin-Kim commented 5 years ago

Thanks! When I tested Deeplab-V2 init weight, it seems not trained on synthetic data. Is there any special reason for different initialization (classification feature / segmentation feature) for different model(Deeplab / FCN8s)?

liyunsheng13 commented 5 years ago

No special reason. You can try different ways to initialize the model. It won't make any difference on the results

MyeongJin-Kim commented 5 years ago

Thanks a lot!