search

perf-project / PeRF

[TPAMI 2024] PERF: Panoramic Neural Radiance Field from a Single Panorama
https://perf-project.github.io/
Other
222 stars 24 forks source link

Undesirable result on example image #4

Open ZiYang-xie opened 1 year ago

ZiYang-xie commented 1 year ago

Hi, thanks for the great work.

I have trained the model with the example panorama image kitchen you provided. However the result seems pretty bad. Looks like the depth estimation or the inpainting model failed to some extend. Do you have any clue of this issue?

Input Image

image

Reconstruction Result

https://github.com/perf-project/PeRF/assets/59246000/aa315054-89b9-4638-9ee8-632652f5cf16

ZiYang-xie commented 1 year ago

Most part of the pointcloud reconstructed from the monocular depth estimator looks good to me. However, I think it might be challenge for the inpainting model to restore the occluded area behind the kitchen island?

ZiYang-xie commented 1 year ago

BTW, The fridge looks normal in the pointcloud but why it seems to be distorted in reconstruction views?

Only-Wion commented 2 months ago

How did I get the pointcloud, was it generated by PeRF or did you process it yourself, I need the pointcloud