search

Fictionarry / ER-NeRF

[ICCV'23] Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis
https://fictionarry.github.io/ER-NeRF/
MIT License
1.05k stars 134 forks source link

References of "uncertainty", "unc_loss" and "unc_net" in "class Trainer(object)" and "class _composite_rays_train_uncertainty(Function)" #104

Open hkingtswcbyy opened 10 months ago

hkingtswcbyy commented 10 months ago

I can't find any references or information of "uncertainty", "unc_loss" and "unc_net" in codes, could you please provide some references about these concepts?

Fictionarry commented 10 months ago

Sorry for replying late! This is used to make the model pay less attention to the areas with little changes and thus facilitate motion learning. The idea is borrowed from uncertainty but the calculation in practice differs from the theory. We treat it as a little trick and have no further study on it. Canceling it may cause some jittering in the mouth area. You can try it by yourself.

hkingtswcbyy commented 10 months ago

Sorry for replying late! This is used to make the model pay less attention to the areas with little changes and thus facilitate motion learning. The idea is borrowed from uncertainty but the calculation in practice differs from the theory. We treat it as a little trick and have no further study on it. Canceling it may cause some jittering in the mouth area. You can try it by yourself.

Thanks a lot for your reply, I think this idea is pretty interesting!