YvanYin / Metric3D

The repo for "Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Image" and "Metric3Dv2: A Versatile Monocular Geometric Foundation Model..."
https://jugghm.github.io/Metric3Dv2/
BSD 2-Clause "Simplified" License
1.47k stars 111 forks source link

Infinite Depth #145

Open HardikJain02 opened 3 months ago

HardikJain02 commented 3 months ago

Room having bright windows tends to have infinite depth, hence non-desirable results. Any workaround?

JUGGHM commented 3 months ago

Room having bright windows tends to have infinite depth, hence non-desirable results. Any workaround?

One way is to first adjust the contrast and brightness of the images. Additionally, consider filtering out regions based on predicted confidence map.

I think it might be challenging to estimate the depth of over-exposed pixels.

HardikJain02 commented 3 months ago

Yeah, brightness might work but for my use case, I cannot prefer it.

I attempted to adjust the depth of the window to match that of the wall it's attached to. I believe there's an issue with the axis transformation. I'll work on fixing it and will update you if it resolves the problem.

Nacriema commented 2 months ago

Hi, did you solved the problem ?