prs-eth / Marigold

[CVPR 2024 - Oral, Best Paper Award Candidate] Marigold: Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation
https://marigoldmonodepth.github.io
Apache License 2.0
2.01k stars 97 forks source link

Vector displacement? [feature request] #48

Open al3dv2 opened 3 months ago

al3dv2 commented 3 months ago

Hi I want to know if it's possible to add vector displacement ? it's allow to get better result than depth map on 3d objects depth vs vector : VectorDisp02

toshas commented 3 weeks ago

Thanks for your interest, @al3dv2! Could you please elaborate on how you would tackle converting Hypersim pre-rendered depth maps into this format? Alternatively, if you know another dataset in this format, I would be curious to learn.