search

LeapLabTHU / ActiveNeRF

Official repository of ActiveNeRF (ECCV2022)
98 stars 8 forks source link

Why don't you add the additional branch (β^2) to the MLP in Eq2? #1

Closed zjwzcx closed 1 year ago

zjwzcx commented 2 years ago

@Panxuran Hi Xuran, thanks for your awesome work!

In Sec 4, you mentioned 'Following previous researches in Bayesian neural networks, we take the model output as the mean'. However, the model outputs the uncertainty/variance β^2(r) in a shallower layer, which is even not related to the input d. It seems more intuitive to have the mean c(r, d) and variance β^2(r) both depend on the same input r(t) and d (just like the following figure, ref to NeurAR). Have you conducted any related experiments or had any insight?

Look forward to your reply!

zjwzcx commented 2 years ago

2022-10-06_14-28

Panxuran commented 1 year ago

In our case, we see the uncertainty estimation as an attribute similar to volume density, thus we omit the influence of viewing direction. Also, this assumption helps us to meet the demand of one of the prerequisites, i.e., the independence of radiance value distribution between different positions.

Nevertheless, from my personal opinion, this remains a open question. Modeling uncertainty with viewing direction may be a promising direction. Hope to see your positive results on trying this!