tiangexiang / OccNeRF

[ICCV 2023] Rendering Humans from Object-Occluded Monocular Videos
https://cs.stanford.edu/~xtiange/projects/occnerf/
MIT License
42 stars 1 forks source link

Question about occluder #7

Closed imabackstabber closed 5 months ago

imabackstabber commented 6 months ago

Hi, I wanna ask about the design of the occluder used in this paper. I read from the paper that 'Without losing generality, we simulate the presence of a box-like obstacle right in front of the camera that causes a rectangular area at the center of the frame to be occluded.'. And I think it should be look like this: image However, I ran the code and found out the occluder is somehow just a black value (RGB: [0,0,0]): image I think the code told it to do so: image So I wonder whether it should be like this(i.e, simply make the occluder black) or should I implement a version the same as the paper? If the latter option is required, how should I do it?

tiangexiang commented 5 months ago

Hi, yes, occluders are treated and processed as the codes implemented. Our intuition is that, when there is an occluder blocking the camera, blocked human body becomes invisible and undetectable by semantic segmentation models. In this way, we obtain an alpha mask that indicates transparency at the invisible parts include both background and occluded regions, which are being processed equally (blended according to bg_color) since they are no different in our methods.

imabackstabber commented 5 months ago

I see. Thanks for you reply!