JeffreyXiang / ivid

PyTorch implementation of the ICCV paper "3D-aware Image Generation using 2D Diffusion Models"
https://jeffreyxiang.github.io/ivid/
MIT License
300 stars 4 forks source link

Question about the back-warp #12

Open ewrfcas opened 2 months ago

ewrfcas commented 2 months ago

Thanks for your impressive work. There is a question: how to build the backward mask? If we render all pixels into a mesh, this mesh is always visible when we warp the view back to the original viewpoint. If we conduct an inverse warping through the original depth, it cannot deal with the occlusion mask issue as below. The first column is the original image, the third column is the forward warping view, and the fifth column is the backward warping view. image