search

ayushtewari / DFM

Implementation of "Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision"
https://diffusion-with-forward-models.github.io/
152 stars 18 forks source link

Depths not consistent in RealEstate10K #16

Open edwinseychelles opened 9 months ago

edwinseychelles commented 9 months ago

Hello authors,

I am new to this and very much admire your work on the RealEstate10K, which I am using for my final project in architectural modeling, utilizing simple sampling. Naturally, depth is quite important for me. However, it seems that it is not consistent when I perform a point cloud of it in Open3D.

It remains almost perfectly consistent for the first few novel views, but as soon as it gets to the last viewpoint, it becomes quite different. Please kindly check out the images. I understand that this should not happen as it is supposed to recover the same 3D scene. I am certain of my implementation of point clouds as I use it for other works as well, and it cannot be the source of error.

Screenshot 2023-12-13 Screenshot 2023-12-13
edwinseychelles commented 9 months ago

Hi,

My initial query, which discussed discrepancies in point cloud consistency across different viewpoints, has not yet received a response.

I have double-checked my implementation, particularly the use of direct values from the Camera object and aspect ratio compensation for magnification. Could you please provide some insights or suggestions on what might be causing this issue? Any guidance or clarification would be greatly appreciated.

Since you claim to have consistent depths, and have already published this paper, I sincerely hope you appreciate the urgency of this request and can provide insights or corrections that might resolve this issue.