MPI-IS / bilateralNN

Learning Sparse High Dimensional Filters with Neural Networks
http://bilateralnn.is.tue.mpg.de
BSD 3-Clause "New" or "Revised" License
69 stars 25 forks source link

What is the difference between Gauss Bilateral and Learned Bilateral? #11

Closed chenchr closed 6 years ago

chenchr commented 6 years ago

Hello. Thank you for sharing this awesom works. I have a question about the result in the paper. 1 If we do not consider the implementation, is the difference between gauss bilateral `` and learned bilateral is that the variance of filter in learned bilateral ``` is learnable and is learned from training ? Thanks!

varunjampani commented 6 years ago

Sorry for my delayed response. Somehow, I missed this.

'Gauss bilateral' refers to Gaussian filter in high-dimensional space. 'Learned bilateral' filter refers to learned filter weights (not just the variance of the filter). You can think of this as learning a high-dimensional convolution filter, just like in standard CNNs. Standard CNNs operate in 2D or 3D space and this work makes it feasible to do convolution in higher dimensional spaces.

chenchr commented 6 years ago

@varunjampani Thanks for your reply. Maybe I have misunderstanding... Do you mean that the learned bilateral filter is not just variance learnable but the weight ? Therefore it directly output the weight, and has no need to calculate the exponential of feature difference and then normalize?

varunjampani commented 6 years ago

Yes, the 'learned' bilateral filter is not just learned variance, but the filter weights in high-dimensional space. You can think of this as a general convolution in high-dimensions. For both non-learned Gaussian and learned filters, we use normalization to account for non-uniformly sampled sparse data in high-dimensions.

chenchr commented 6 years ago

Thanks for your reply.