search

yinboc / liif

Learning Continuous Image Representation with Local Implicit Image Function, in CVPR 2021 (Oral)
https://yinboc.github.io/liif/
BSD 3-Clause "New" or "Revised" License
1.27k stars 145 forks source link

What is the difference between the proposed local ensemble and bilinear interpolation? #40

Open YingqianWang opened 3 years ago

YingqianWang commented 3 years ago

In Fig. 2, the authors propose a local ensemble approach to predict the RGB value of the target position based on its four nearest neighbors. However, the calculation process of the local ensemble is very similar to that of bilinear interpolation. Then I have a question: why not directly using bilinear interpolation in the F.grid_sample function? Looking forward to your early reply.

Regards

shkarupa-alex commented 2 years ago

I think if we will use bilinear interpolation we will fall in the issue that it smooth features (due to always linear combination based on distance). This is one of the main drawbacks when using interpolation in semantic segmentation.

When using local ensemble features are just stacked and following imnet (mlp) can combine them with non-linear weights.