Lakonik / SSDNeRF

[ICCV 2023] Single-Stage Diffusion NeRF
https://lakonik.github.io/ssdnerf/
MIT License
437 stars 23 forks source link

Question on image conditioning for sparse-view reconstruction #7

Closed jychoi118 closed 1 year ago

jychoi118 commented 1 year ago

Thank you for sharing the code. The work is very interesting.

Have you tried training image-conditioned diffusion model for sparse-view reconstruction?

As I understand the paper, SSDNeRF uses unconditional diffusion model + guidance, instead of a conditional diffusion model. I found concatenation conditioning in the code, but it seems to be unused.

Lakonik commented 1 year ago

Thank you for your interest in our work! Our preliminary results show that vanilla concat conditioning + guidance works better than guidance alone, and can generalize to multiple categories. But this is still at a very early stage so we have not yet included the config for image-conditioned model.

jychoi118 commented 1 year ago

Thank you for your response!