ashawkey / stable-dreamfusion

Text-to-3D & Image-to-3D & Mesh Exportation with NeRF + Diffusion.
Apache License 2.0
7.99k stars 710 forks source link

Question on image to 3d pipeline #320

Open pushkalkatara opened 1 year ago

pushkalkatara commented 1 year ago

Hi, thanks for the amazing work.

I have been playing around with image to 3d pipeline with zero123 guidance.

Image, Depth, Normal: bowl_rgba bowl_depth bowl_normal

Rendering: df_ep0100_rgb

While debugging, I am able to get valid pose images from the zero123d generations but the nerf rendering process doesn't seem to capture the hollow details of the bowl. I am curious if the depth and normal are the failure reason in this case.

Multiview images from zero123d:

image image