search

fudan-zvg / PGC-3D

[ICLR 2024] Enhancing High-Resolution 3D Generation through Pixel-wise Gradient Clipping
Apache License 2.0
74 stars 1 forks source link

where Linear Approx is used #6

Open Zhang-Jiahui opened 1 month ago

Zhang-Jiahui commented 1 month ago

Hi! You paper is great! I want to ask something about the Linear Approx because I meet the same texture bluring issues when using sdxl to generate 3D just like the image below: image

Linear Approx is used to substitute the grad of VAE. Is it right? I want to use the same trick but I didn't find the position where it is used. Would you help me point out the position? I would appreciate it if you could help. Thanks.

mdarhdarz commented 1 month ago

Thanks for your attention! Linear Approx is the simplest way for identifying the gradient issue, but it is not the final solution. Our proposed solution is pixel-wise gradient clipping (PGC). The reference code for Linear Approx: 2d.py#L193-200 The reference code for PGC: nerf/fine/trainer.py#L718-750