search

luciddreamer-cvlab / LucidDreamer

Official code for the paper "LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes".
Other
1.33k stars 98 forks source link

Using Marigold for depth map generation #29

Open oogamicloud opened 9 months ago

oogamicloud commented 9 months ago

Do you have plans to make Marigold compatible for depth map generation? In addition to ZoeDepth, it would be great to have the ability to generate depth maps using Marigold.

https://github.com/prs-eth/Marigold

esw0116 commented 9 months ago

Hello, we are planning to combine our model with Marigold, a better depth estimation model. However, we noticed that naively replacing Zoedepth with Marigold gives worse result since Marigold provides a normalized depth from 0 to 1. I think we should involve more tricks to mitigate the issues. However, we are expecting 3D scenes with much better quality using a new model!