scaelles / OSVOS-TensorFlow

One-Shot Video Object Segmentation
http://vision.ee.ethz.ch/~cvlsegmentation/osvos/
GNU General Public License v3.0
438 stars 132 forks source link

Boundary snapping #2

Closed bhack closed 7 years ago

bhack commented 7 years ago

Taking a look to the paper tables seems that boundary snapping branch is still relevant. What we can try to use in this flavour?

scaelles commented 7 years ago

The boundary snapping gives a boost of around 2.5% on the IoU metric as shown in the paper. Therefore, it is a refinement of the appearance model (the one that this code reproduces) and not the core of the algorithm. The boundary snapping is implemented in Matlab and implementing it in python would require quite a lot of time so we are not planning to do it.

In the paper we also tried another refinement using the Fast Bilateral Solver which also gives a nice (but smaller than boundary snapping) improvement and there is code available in python. Thus, I would recommend you to give it a try.

bhack commented 7 years ago

There is a c++ implementation if you are interested

scaelles commented 7 years ago

Thanks for your suggestion. Also, if you would like to use the boundary snapping, I recommend you to use the caffe version.