kmaninis / OSVOS-PyTorch

PyTorch implementation of One-Shot Video Object Segmentation (OSVOS)
http://vision.ee.ethz.ch/~cvlsegmentation/osvos
GNU General Public License v3.0
563 stars 106 forks source link

The code of contour snap #33

Closed ZhiQue930716 closed 5 years ago

ZhiQue930716 commented 5 years ago

Hi, I read your paper, but I can not find the part of code about contour snap which expressed in paper. Especially,the Fast Bilateral Solver(FBS) and the CNN trained to detect object contour. Could you show me that. Thanks.

scaelles commented 5 years ago

The boundary snapping gives a boost of around 2.5% on the IoU metric as shown in the paper. Therefore, it is a refinement of the appearance model (the one that this code reproduces) and not the core of the algorithm. The boundary snapping is implemented in Matlab and implementing it in python would require quite a lot of time so we are not planning to do it. If you would like to use it, you can try the caffe version.

In the paper we also tried another refinement using the Fast Bilateral Solver which also gives a nice (but smaller than boundary snapping) improvement and there is code available in python. Thus, I would recommend you to give it a try.