search

pals-ttic / sjc

Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation (CVPR 2023)
https://pals.ttic.edu/p/score-jacobian-chaining
Other
499 stars 15 forks source link

Fantastic Work #2

Open lalalune opened 1 year ago

lalalune commented 1 year ago

Just wanted to say--

This is incredibly interesting work and seems to have a robustness to Janus issues (front identity applied to many angles) and quality of color that we've not yet seen from open source implementations of Dreamfusion.

w-hc commented 1 year ago

Thanks for the encouragement! The issue of front face hallucination (Janus) remains unresolved in many cases, and we are exploring some solutions less reliant on the language model than view-dependent prompting.

SJC does not pursue surface modeling the same way that DreamFusion does (we hope to gradually develop the skills). The latitude a full volumetric representation has makes the burger meat looks more realistic (even without view dependencies in a nerf such as ours). To be fair, this is more of a trade-off.

We will continue to try to improve the quality & robustness of the codebase.