kwea123 / ngp_pl

Instant-ngp in pytorch+cuda trained with pytorch-lightning (high quality with high speed, with only few lines of legible code)
MIT License
1.26k stars 156 forks source link

Poor reconstruction with white background in real dataset #131

Open davidedinuc opened 1 year ago

davidedinuc commented 1 year ago

I'm currently working on reconstructing the scene of the sedan dataset, which I downloaded from the Ref-NeRF project. My goal is to apply the seg2former architecture to perform segmentation of the car in the images and reconstruct only the car, excluding the rest of the scene.

I have experimented with setting the background as white, similar to synthetic datasets, as well as black. Interestingly, I have observed that using a white background results in significant noise, whereas a black background produces much better results.

I'm curious to understand the reason behind this discrepancy. Why does the white background work well with synthetic data but not with real datasets? Is there an explanation for this behavior?