jiwoon-ahn / irn

Weakly Supervised Learning of Instance Segmentation with Inter-pixel Relations, CVPR 2019 (Oral)
MIT License
528 stars 99 forks source link

Tuning GN using inference data? #16

Closed zhaohui-yang closed 5 years ago

zhaohui-yang commented 5 years ago

Dear Jiwoon, in the file 'train_irn.py', I noticed that GN was tuning using the inference data in the latest commit, location. Is this right in the weakly supervised instance segmentation setting? I think the validation set should not be touched except for evaluation, rather than training/tuning parameters. And I'm also curious what would be affected by this? Will the mAP be improved? Thanks

jiwoon-ahn commented 5 years ago
  1. GN is not tuned during that procedure.
  2. "infer dataset" is a subset of our training data, and we strictly assume no annotation except image-level class labels is available on the dataset.

What MeanShift layer does is simple: It simply collects the mean of the displacement fields from the training set, and it adjusts the range of the values at inference. The layer acts just as before. In the last commit, I just modified the layer so that it no longer depends on BatchNorm2d.

zhaohui-yang commented 5 years ago

Thanks, I know what you mean. Just optimize the mean value while fixing all the other parameters, right?

jiwoon-ahn commented 5 years ago

You got it. :)